Jun 16 08:33:43 devstack cinder-volume[81476]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 16 08:33:43 devstack cinder-volume[81476]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 16 08:33:43 devstack cinder-volume[81476]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 16 08:33:43 devstack cinder-volume[81476]: INFO dbcounter [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Registered counter for database cinder Jun 16 08:33:43 devstack cinder-volume[81476]: DEBUG oslo_db.sqlalchemy.engines [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81476) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG dbcounter [-] [81476] Writer thread running {{(pid=81476) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 16 08:33:44 devstack cinder-volume[81476]: INFO cinder.rpc [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 16 08:33:44 devstack cinder-volume[81476]: INFO cinder.rpc [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_db.sqlalchemy.engines [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81476) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 16 08:33:44 devstack cinder-volume[81476]: INFO cinder.volume.manager [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Determined volume DB was empty at startup. Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG cinder.volume.manager [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81476) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 16 08:33:44 devstack cinder-volume[81476]: INFO cinder.volume.manager [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 16 08:33:44 devstack cinder-volume[81476]: WARNING stevedore.named [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 16 08:33:44 devstack cinder-volume[81476]: WARNING castellan.key_manager [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 16 08:33:44 devstack cinder-volume[81476]: WARNING cinder.keymgr.conf_key_mgr [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG cinder.volume.drivers.lvm [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=81476) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_concurrency.processutils [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=81476) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_concurrency.processutils [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] CMD "cinder-rtstool verify" returned: 0 in 0.366s {{(pid=81476) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_db.sqlalchemy.engines [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81476) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 16 08:33:44 devstack cinder-volume[81476]: INFO cinder.rpc [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 16 08:33:44 devstack cinder-volume[81476]: INFO cinder.rpc [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 16 08:33:44 devstack cinder-volume[81476]: WARNING stevedore.named [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 16 08:33:44 devstack cinder-volume[81476]: WARNING castellan.key_manager [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 16 08:33:44 devstack cinder-volume[81476]: INFO cinder.volume.manager [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_db.sqlalchemy.engines [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81476) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 16 08:33:44 devstack cinder-volume[81476]: INFO oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Starting 1 workers Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Started child 81646 {{(pid=81476) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Full set of CONF: {{(pid=81476) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] ******************************************************************************** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Configuration options gathered from: {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] ================================================================================ {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] allow_availability_zone_fallback = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] allow_compression_on_image_upload = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] allowed_direct_url_schemes = [] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] api_rate_limit = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] auth_strategy = keystone {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] az_cache_duration = 3600 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_availability_zone = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_host = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_name = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_stats_polling_interval = 60 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backup_api_class = cinder.backup.api.API {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backup_name_template = backup-%s {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backup_use_same_host = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81646]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backup_use_temp_snapshot = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] chap_password = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] chap_username = {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cinder_internal_tenant_project_id = dfffa918307747d186b53f5280e849c0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cinder_internal_tenant_user_id = 6b14d1e710364427a2a7b00c8fcd9a1f {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cloned_volume_same_az = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cluster = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] compression_format = gzip {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] compute_api_class = cinder.compute.nova.API {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] config_dir = [] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] config_source = [] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] control_exchange = openstack {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] debug = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] default_availability_zone = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] default_group_type = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] default_volume_type = lvmdriver-1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] disk_geometry = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] driver_client_cert = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] driver_client_cert_key = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] driver_data_namespace = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] driver_ssl_cert_path = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] driver_ssl_cert_verify = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] driver_use_ssl = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] enable_force_upload = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] enable_new_services = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] enable_unsupported_driver = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] enabled_backends = ['lvmdriver-1'] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] enforce_multipath_for_image_xfer = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] filter_function = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance_api_insecure = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance_api_servers = ['http://192.168.122.135/image'] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance_api_ssl_compression = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance_ca_certificates_file = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance_catalog_info = image:glance:publicURL {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance_certfile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance_keyfile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance_num_retries = 3 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance_request_timeout = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] goodness_function = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] graceful_shutdown_timeout = 5 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] group_api_class = cinder.group.api.API {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] host = devstack {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] image_compress_on_upload = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] image_conversion_address_space_limit = 1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] image_conversion_cpu_limit = 60 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] image_conversion_disable = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] image_upload_use_cinder_backend = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] image_upload_use_internal_tenant = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] image_volume_cache_enabled = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] image_volume_cache_max_count = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] image_volume_cache_max_size_gb = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] init_host_max_objects_retrieval = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] instance_format = [instance: %(uuid)s] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] iscsi_target_flags = {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] iscsi_write_cache = on {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] iser_helper = tgtadm {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] iser_ip_address = 192.168.122.135 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] iser_port = 3260 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] log_color = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] log_config_append = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] log_dir = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] log_file = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] log_options = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] log_rotate_interval = 1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] log_rotate_interval_type = days {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] log_rotation_type = none {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] max_age = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] max_logfile_count = 30 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] max_logfile_size_mb = 200 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] max_over_subscription_ratio = 20.0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] message_reap_interval = 86400 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] message_ttl = 2592000 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] migration_create_volume_timeout_secs = 300 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] monkey_patch = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] monkey_patch_modules = [] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] my_ip = 192.168.122.135 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] no_snapshot_gb_quota = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] num_iser_scan_tries = 3 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] num_shell_tries = 3 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] num_volume_device_scan_tries = 3 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] nvmeof_conn_info_version = 1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] nvmet_ns_id = 10 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] nvmet_port_id = 1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] osapi_max_limit = 1000 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] osapi_volume_ext_list = [] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] osapi_volume_listen_port = 8776 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] osapi_volume_use_ssl = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] osapi_volume_workers = 2 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] per_volume_size_limit = -1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] periodic_fuzzy_delay = 60 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] periodic_interval = 60 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] public_endpoint = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] publish_errors = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] quota_backup_gigabytes = 1000 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] quota_backups = 10 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] quota_gigabytes = 1000 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] quota_groups = 10 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] quota_snapshots = 10 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] quota_volumes = 10 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] rate_limit_burst = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] rate_limit_except_level = CRITICAL {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] rate_limit_interval = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] reinit_driver_count = 3 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] replication_device = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] report_discard_supported = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] report_interval = 120 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] reservation_clean_interval = 86400 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] reservation_expire = 86400 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] reserved_image_namespaces = [] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] reserved_percentage = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] rpc_response_timeout = 120 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] run_external_periodic_tasks = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] scst_target_driver = iscsi {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] scst_target_iqn_name = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] service_down_time = 720 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] shell_completion = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] snapshot_name_template = snapshot-%s {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] snapshot_same_host = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] split_loggers = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] state_path = /opt/stack/data/cinder {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] storage_availability_zone = nova {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] storage_protocol = iSCSI {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] syslog_log_facility = LOG_USER {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] target_helper = lioadm {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] target_ip_address = 192.168.122.135 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] target_port = 3260 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] target_protocol = iscsi {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] target_secondary_ip_addresses = [] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] trace_flags = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81646]: INFO cinder.volume.manager [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] transport_url = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] until_refresh = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] use_chap_auth = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] use_default_quota_class = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] use_journal = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] use_json = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] use_multipath_for_image_xfer = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] use_stderr = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] use_syslog = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] verify_glance_signatures = enabled {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] volume_api_class = cinder.volume.api.API {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] volume_backend_name = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] volume_clear = zero {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] volume_clear_ionice = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] volume_clear_size = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] volume_copy_bps_limit = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] volume_dd_blocksize = 1M {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] volume_name_template = volume-%s {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] volume_service_inithost_offload = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] volume_usage_audit_period = month {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] zoning_mode = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_concurrency.disable_process_locking = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.admin_password = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.admin_token = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.admin_user = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.auth_port = 35357 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.auth_protocol = https {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.auth_section = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.auth_type = password {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.auth_uri = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.auth_version = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.cache = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.certfile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.identity_uri = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.include_service_catalog = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.insecure = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.interface = public {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.keyfile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.memcache_password = {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.memcache_username = {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.region_name = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.service_type = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.backend = dogpile.cache.null {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.backend_argument = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.backend_expiration_time = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.config_prefix = cache.oslo {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.debug_cache_backend = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.enable_retry_client = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.enable_socket_keepalive = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.enabled = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.enforce_fips_mode = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.expiration_time = 600 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.hashclient_retry_attempts = 2 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.memcache_dead_retry = 300 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.memcache_pool_maxsize = 10 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.memcache_sasl_enabled = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.password = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.proxies = [] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.redis_db = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:44 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.redis_server = localhost:6379 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.retry_attempts = 2 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.retry_delay = 0.0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.socket_keepalive_count = 1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.socket_keepalive_idle = 1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.socket_keepalive_interval = 1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.socket_timeout = 1.0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.tls_allowed_ciphers = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.tls_cafile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.tls_certfile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.tls_enabled = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.tls_keyfile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cache.username = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.asyncio_connection = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.asyncio_slave_connection = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.backend = sqlalchemy {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.connection = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.connection_debug = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.connection_parameters = {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.connection_recycle_time = 3600 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack sudo[81650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.connection_trace = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.db_inc_retry_interval = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.db_max_retries = 20 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.db_max_retry_interval = 10 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.db_retry_interval = 1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.max_overflow = 50 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.max_pool_size = 5 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack sudo[81650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.max_retries = 10 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.mysql_wsrep_sync_wait = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.pool_timeout = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.retry_interval = 10 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.slave_connection = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.sqlite_synchronous = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.synchronous_reader = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] database.use_db_reconnect = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] profiler.connection_string = messaging:// {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] profiler.enabled = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] profiler.es_doc_type = notification {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] profiler.es_scroll_size = 10000 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] profiler.es_scroll_time = 2m {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] profiler.filter_error_trace = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] profiler.hmac_keys = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] profiler.sentinel_service_name = mymaster {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] profiler.socket_timeout = 0.1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] profiler.trace_requests = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] profiler.trace_sqlalchemy = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] profiler_jaeger.process_tags = {} {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] profiler_jaeger.service_name_prefix = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] profiler_otlp.service_name_prefix = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_policy.enforce_new_defaults = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: WARNING oslo_config.cfg [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_policy.enforce_scope = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_policy.policy_default_rule = default {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_policy.policy_file = policy.yaml {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] coordination.backend_url = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] privsep_osbrick.group = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] privsep_osbrick.helper_command = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] privsep_osbrick.user = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cinder_sys_admin.group = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cinder_sys_admin.helper_command = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] cinder_sys_admin.user = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] service_user.auth_section = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] service_user.auth_type = password {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] service_user.cafile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] service_user.certfile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] service_user.collect_timing = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] service_user.insecure = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] service_user.keyfile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] service_user.send_service_user_token = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] service_user.split_loggers = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] service_user.timeout = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance.auth_section = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance.auth_type = password {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance.certfile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance.collect_timing = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance.insecure = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance.keyfile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance.region_name = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance.split_loggers = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] glance.timeout = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.backend_availability_zone = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.chap_password = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.chap_username = {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.disk_geometry = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.driver_client_cert = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.driver_client_cert_key = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.driver_data_namespace = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.driver_use_ssl = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.extra_capabilities = {} {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.filter_function = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.goodness_function = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.iscsi_target_flags = {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.iscsi_write_cache = on {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.iser_helper = tgtadm {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.iser_port = 3260 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.lvm_mirrors = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.lvm_share_target = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.lvm_type = auto {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.num_shell_tries = 3 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.replication_device = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.report_discard_supported = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.reserved_percentage = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.target_helper = tgtadm {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.target_port = 3260 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.target_protocol = iscsi {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.trace_flags = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.unique_fqdn_network = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.use_chap_auth = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.volume_backend_name = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.volume_clear = zero {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.volume_clear_ionice = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.volume_clear_size = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.volume_group = cinder-volumes {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_reports.file_event_handler = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_reports.log_dir = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.backend_availability_zone = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.backend_host = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.chap_password = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.chap_username = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.chiscsi_conf = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.disk_geometry = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.driver_client_cert = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.driver_data_namespace = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.driver_use_ssl = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.extra_capabilities = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.filter_function = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.goodness_function = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.iser_helper = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.iser_ip_address = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.iser_port = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.iser_target_prefix = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.lvm_conf_file = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.lvm_mirrors = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.lvm_share_target = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.lvm_type = auto {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.num_shell_tries = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.nvmet_port_id = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.replication_device = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.report_discard_supported = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.reserved_percentage = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.scst_target_driver = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.storage_protocol = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.target_helper = lioadm {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.target_ip_address = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.target_port = 3260 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.target_protocol = iscsi {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.trace_flags = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.use_chap_auth = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.volume_clear = zero {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.volume_clear_size = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] lvmdriver-1.volumes_dir = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.ssl = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_notifications.driver = [] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_notifications.retry = -1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] key_manager.fixed_key = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican.barbican_api_version = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican.barbican_endpoint = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican.barbican_endpoint_type = public {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican.barbican_region_name = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican.cafile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican.certfile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican.collect_timing = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican.insecure = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican.keyfile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican.number_of_retries = 60 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican.retry_delay = 1 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican.send_service_user_token = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican.split_loggers = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican.timeout = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican.verify_ssl = True {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican.verify_ssl_path = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican_service_user.auth_section = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican_service_user.auth_type = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican_service_user.cafile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican_service_user.certfile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican_service_user.collect_timing = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican_service_user.insecure = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican_service_user.keyfile = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican_service_user.split_loggers = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] barbican_service_user.timeout = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] vault.approle_role_id = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] vault.approle_secret_id = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] vault.kv_mountpoint = secret {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] vault.kv_path = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] vault.kv_version = 2 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] vault.namespace = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] vault.root_token_id = **** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] vault.ssl_ca_crt_file = None {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] vault.timeout = 60.0 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] vault.use_ssl = False {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:33:45 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] ******************************************************************************** {{(pid=81476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 16 08:33:45 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.835s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:45 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:45 devstack sudo[81650]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:45 devstack sudo[81821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 16 08:33:45 devstack sudo[81821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:46 devstack sudo[81821]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:46 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.661s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:46 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:33:46 devstack cinder-volume[81646]: INFO cinder.brick.local_dev.lvm [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 16 08:33:46 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:46 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:46 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:46 devstack sudo[82037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 16 08:33:46 devstack sudo[82037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:47 devstack sudo[82037]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:47 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:47 devstack cinder-volume[81646]: DEBUG cinder.brick.local_dev.lvm [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=81646) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 16 08:33:47 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:47 devstack sudo[82215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 16 08:33:47 devstack sudo[82215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:48 devstack sudo[82215]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:48 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.176s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:48 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:48 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:48 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:48 devstack sudo[82420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 16 08:33:48 devstack sudo[82420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:49 devstack sudo[82420]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:49 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.800s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:49 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:49 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:49 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:49 devstack sudo[82427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 16 08:33:49 devstack sudo[82427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:49 devstack sudo[82427]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:49 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.699s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:49 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:49 devstack sudo[82437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 16 08:33:49 devstack sudo[82437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:50 devstack sudo[82437]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:50 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:50 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:50 devstack sudo[82442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 16 08:33:50 devstack sudo[82442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:51 devstack sudo[82442]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:51 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:51 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:51 devstack sudo[82445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 16 08:33:51 devstack sudo[82445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:51 devstack sudo[82445]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:51 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:51 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:51 devstack sudo[82450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 16 08:33:51 devstack sudo[82450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:52 devstack sudo[82450]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:52 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.667s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:52 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:52 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:52 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:52 devstack sudo[82455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 16 08:33:52 devstack sudo[82455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:53 devstack sudo[82455]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:53 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.074s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:53 devstack cinder-volume[81646]: INFO cinder.volume.drivers.lvm [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 16 08:33:53 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:53 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:53 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:53 devstack sudo[82474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 16 08:33:53 devstack sudo[82474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:54 devstack sudo[82474]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:54 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.755s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:54 devstack cinder-volume[81646]: DEBUG cinder.volume.drivers.lvm [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Updating volume stats {{(pid=81646) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 16 08:33:54 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:54 devstack sudo[82621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 16 08:33:54 devstack sudo[82621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:54 devstack cinder-volume[81476]: DEBUG dbcounter [-] [81476] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=81476) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:33:55 devstack sudo[82621]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:55 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.742s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:55 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:55 devstack sudo[82766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 16 08:33:55 devstack sudo[82766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:55 devstack sudo[82766]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:55 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:55 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:55 devstack sudo[82769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 16 08:33:55 devstack sudo[82769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:56 devstack sudo[82769]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:56 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.572s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:56 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:56 devstack sudo[82775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 16 08:33:56 devstack sudo[82775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:56 devstack sudo[82775]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:56 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.575s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:56 devstack cinder-volume[81646]: INFO cinder.volume.driver [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Driver hasn't implemented _init_vendor_properties() Jun 16 08:33:56 devstack cinder-volume[81646]: DEBUG cinder.volume.driver [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81646) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 16 08:33:56 devstack cinder-volume[81646]: DEBUG oslo_db.sqlalchemy.engines [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81646) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 16 08:33:57 devstack cinder-volume[81646]: DEBUG dbcounter [-] [81646] Writer thread running {{(pid=81646) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 16 08:33:57 devstack cinder-volume[81646]: DEBUG cinder.db.sqlalchemy.api [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Building query based on filter {{(pid=81646) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 16 08:33:57 devstack cinder-volume[81646]: DEBUG cinder.image.image_utils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81646) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 16 08:33:57 devstack cinder-volume[81646]: INFO cinder.keymgr.migration [None req-b3008db5-9e5d-43a9-95cd-f13519397760 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 16 08:33:57 devstack cinder-volume[81646]: DEBUG cinder.volume.drivers.lvm [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Updating volume stats {{(pid=81646) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 16 08:33:57 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:57 devstack sudo[82779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 16 08:33:57 devstack sudo[82779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:57 devstack sudo[82779]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:57 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:57 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:57 devstack sudo[82783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 16 08:33:57 devstack sudo[82783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:58 devstack sudo[82783]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:58 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.580s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:58 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:58 devstack sudo[82786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 16 08:33:58 devstack sudo[82786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:58 devstack sudo[82786]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:58 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.609s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:58 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:58 devstack sudo[82790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 16 08:33:58 devstack sudo[82790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:33:59 devstack sudo[82790]: pam_unix(sudo:session): session closed for user root Jun 16 08:33:59 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:33:59 devstack cinder-volume[81646]: DEBUG cinder.manager [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Notifying Schedulers of capabilities ... {{(pid=81646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:33:59 devstack cinder-volume[81646]: INFO cinder.volume.manager [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Driver initialization completed successfully. Jun 16 08:33:59 devstack cinder-volume[81646]: INFO cinder.manager [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Initiating service 2 cleanup Jun 16 08:33:59 devstack cinder-volume[81646]: INFO cinder.manager [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Service 2 cleanup completed. Jun 16 08:33:59 devstack cinder-volume[81646]: DEBUG cinder.service [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Creating RPC server for service cinder-volume {{(pid=81646) start /opt/stack/cinder/cinder/service.py:231}} Jun 16 08:33:59 devstack cinder-volume[81646]: DEBUG cinder.service [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81646) start /opt/stack/cinder/cinder/service.py:237}} Jun 16 08:33:59 devstack cinder-volume[81646]: INFO cinder.volume.manager [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 16 08:33:59 devstack cinder-volume[81646]: DEBUG cinder.volume.drivers.lvm [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Updating volume stats {{(pid=81646) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 16 08:33:59 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:33:59 devstack sudo[82797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 16 08:33:59 devstack sudo[82797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:34:00 devstack sudo[82797]: pam_unix(sudo:session): session closed for user root Jun 16 08:34:00 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:34:00 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:34:00 devstack sudo[82801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 16 08:34:00 devstack sudo[82801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:34:00 devstack sudo[82801]: pam_unix(sudo:session): session closed for user root Jun 16 08:34:00 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:34:00 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:34:00 devstack sudo[82804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 16 08:34:00 devstack sudo[82804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:34:01 devstack sudo[82804]: pam_unix(sudo:session): session closed for user root Jun 16 08:34:01 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.605s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:34:01 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:34:01 devstack sudo[82861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 16 08:34:01 devstack sudo[82861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:34:02 devstack sudo[82861]: pam_unix(sudo:session): session closed for user root Jun 16 08:34:02 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:34:02 devstack cinder-volume[81646]: INFO cinder.volume.manager [None req-48e619d3-d2f2-4b5e-ad67-ac2fd9c200ed None None] Driver post RPC initialization completed successfully. Jun 16 08:34:09 devstack cinder-volume[81646]: DEBUG dbcounter [-] [81646] Writing DB stats cinder:SELECT=3 {{(pid=81646) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:34:12 devstack cinder-volume[81646]: DEBUG dbcounter [-] [81646] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=81646) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:34:40 devstack cinder-volume[81646]: DEBUG oslo_service.periodic_task [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running periodic task VolumeManager._thread_info {{(pid=81646) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:34:40 devstack cinder-volume[81646]: DEBUG cinder.volume.manager [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] thread count: 6 {{(pid=81646) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:34:40 devstack cinder-volume[81646]: DEBUG cinder.volume.manager [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] thread info: [<_MainThread(MainThread, started 124755120595072)>, , , , , ] {{(pid=81646) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:35:40 devstack cinder-volume[81646]: DEBUG oslo_service.periodic_task [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81646) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:35:40 devstack cinder-volume[81646]: DEBUG cinder.volume.drivers.lvm [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Updating volume stats {{(pid=81646) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 16 08:35:40 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:35:40 devstack sudo[87576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 16 08:35:40 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:35:40 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root Jun 16 08:35:40 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.593s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:35:40 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:35:40 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 16 08:35:40 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:35:41 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Jun 16 08:35:41 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:35:41 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:35:41 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 16 08:35:41 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:35:41 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Jun 16 08:35:41 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.591s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:35:41 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:35:41 devstack sudo[87593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 16 08:35:41 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:35:42 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root Jun 16 08:35:42 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.598s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:35:42 devstack cinder-volume[81646]: DEBUG cinder.manager [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Notifying Schedulers of capabilities ... {{(pid=81646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:35:42 devstack cinder-volume[81646]: DEBUG oslo_service.periodic_task [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running periodic task VolumeManager._thread_info {{(pid=81646) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:35:42 devstack cinder-volume[81646]: DEBUG cinder.volume.manager [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] thread count: 6 {{(pid=81646) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:35:42 devstack cinder-volume[81646]: DEBUG cinder.volume.manager [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] thread info: [<_MainThread(MainThread, started 124755120595072)>, , , , , ] {{(pid=81646) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:36:12 devstack cinder-volume[81646]: DEBUG dbcounter [-] [81646] Writing DB stats cinder:SELECT=1 {{(pid=81646) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:36:12 devstack cinder-volume[81646]: DEBUG dbcounter [-] [81646] Writing DB stats cinder:UPDATE=1 {{(pid=81646) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:36:40 devstack cinder-volume[81646]: DEBUG oslo_service.periodic_task [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81646) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:36:40 devstack cinder-volume[81646]: DEBUG cinder.volume.drivers.lvm [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Updating volume stats {{(pid=81646) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 16 08:36:40 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:36:40 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 16 08:36:40 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:36:40 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Jun 16 08:36:40 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.590s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:36:40 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:36:40 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 16 08:36:40 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:36:41 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Jun 16 08:36:41 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:36:41 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:36:41 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 16 08:36:41 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:36:41 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Jun 16 08:36:41 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.589s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:36:41 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:36:41 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 16 08:36:41 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:36:42 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Jun 16 08:36:42 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:36:42 devstack cinder-volume[81646]: DEBUG cinder.manager [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Notifying Schedulers of capabilities ... {{(pid=81646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:36:42 devstack cinder-volume[81646]: DEBUG oslo_service.periodic_task [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running periodic task VolumeManager._thread_info {{(pid=81646) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:36:42 devstack cinder-volume[81646]: DEBUG cinder.volume.manager [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] thread count: 6 {{(pid=81646) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:36:42 devstack cinder-volume[81646]: DEBUG cinder.volume.manager [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] thread info: [<_MainThread(MainThread, started 124755120595072)>, , , , , ] {{(pid=81646) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:37:40 devstack cinder-volume[81646]: DEBUG oslo_service.periodic_task [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81646) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:37:40 devstack cinder-volume[81646]: DEBUG cinder.volume.drivers.lvm [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Updating volume stats {{(pid=81646) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 16 08:37:40 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:37:40 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 16 08:37:40 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:37:40 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Jun 16 08:37:40 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:37:40 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:37:40 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 16 08:37:40 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:37:41 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Jun 16 08:37:41 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.590s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:37:41 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:37:41 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 16 08:37:41 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:37:41 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Jun 16 08:37:41 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.598s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:37:41 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:37:41 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 16 08:37:41 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:37:42 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Jun 16 08:37:42 devstack cinder-volume[81646]: DEBUG oslo_concurrency.processutils [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.583s {{(pid=81646) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:37:42 devstack cinder-volume[81646]: DEBUG cinder.manager [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Notifying Schedulers of capabilities ... {{(pid=81646) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:37:42 devstack cinder-volume[81646]: DEBUG oslo_service.periodic_task [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] Running periodic task VolumeManager._thread_info {{(pid=81646) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:37:42 devstack cinder-volume[81646]: DEBUG cinder.volume.manager [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] thread count: 6 {{(pid=81646) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:37:42 devstack cinder-volume[81646]: DEBUG cinder.volume.manager [None req-21bc758f-753d-41ea-a256-5fd83466131e None None] thread info: [<_MainThread(MainThread, started 124755120595072)>, , , , , ] {{(pid=81646) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:38:12 devstack cinder-volume[81646]: DEBUG dbcounter [-] [81646] Writing DB stats cinder:SELECT=1 {{(pid=81646) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:38:12 devstack cinder-volume[81646]: DEBUG dbcounter [-] [81646] Writing DB stats cinder:UPDATE=1 {{(pid=81646) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:38:20 devstack cinder-volume[81476]: INFO oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Caught SIGTERM, stopping children Jun 16 08:38:20 devstack cinder-volume[81476]: DEBUG oslo_concurrency.lockutils [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Acquiring lock "singleton_lock" {{(pid=81476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 16 08:38:20 devstack cinder-volume[81476]: DEBUG oslo_concurrency.lockutils [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Acquired lock "singleton_lock" {{(pid=81476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 16 08:38:20 devstack cinder-volume[81476]: DEBUG oslo_concurrency.lockutils [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Releasing lock "singleton_lock" {{(pid=81476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 16 08:38:20 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Stop services. {{(pid=81476) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 16 08:38:20 devstack cinder-volume[81476]: DEBUG oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Killing children. {{(pid=81476) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 16 08:38:20 devstack cinder-volume[81476]: INFO oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Waiting on 1 children to exit Jun 16 08:38:24 devstack cinder-volume[81646]: DEBUG oslo_concurrency.lockutils [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Acquiring lock "singleton_lock" {{(pid=81646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 16 08:38:24 devstack cinder-volume[81646]: DEBUG oslo_concurrency.lockutils [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Acquired lock "singleton_lock" {{(pid=81646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 16 08:38:24 devstack cinder-volume[81646]: DEBUG oslo_concurrency.lockutils [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Releasing lock "singleton_lock" {{(pid=81646) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 16 08:38:24 devstack cinder-volume[81646]: WARNING amqp [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 16 08:38:24 devstack cinder-volume[81646]: WARNING amqp [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 16 08:38:24 devstack cinder-volume[81476]: INFO oslo_service.backend._eventlet.service [None req-eff37018-1098-4aaf-b6d6-dbb4fa10a1b0 None None] Child 81646 exited with status 0 Jun 16 08:38:27 devstack cinder-volume[91366]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91366) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 16 08:38:27 devstack cinder-volume[91366]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91366) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 16 08:38:27 devstack cinder-volume[91366]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91366) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 16 08:38:27 devstack cinder-volume[91366]: INFO dbcounter [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Registered counter for database cinder Jun 16 08:38:27 devstack cinder-volume[91366]: DEBUG oslo_db.sqlalchemy.engines [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91366) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG dbcounter [-] [91366] Writer thread running {{(pid=91366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 16 08:38:28 devstack cinder-volume[91366]: INFO cinder.rpc [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 16 08:38:28 devstack cinder-volume[91366]: INFO cinder.rpc [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_db.sqlalchemy.engines [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91366) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 16 08:38:28 devstack cinder-volume[91366]: INFO cinder.volume.manager [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Determined volume DB was empty at startup. Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG cinder.volume.manager [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91366) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 16 08:38:28 devstack cinder-volume[91366]: INFO cinder.volume.manager [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 16 08:38:28 devstack cinder-volume[91366]: WARNING stevedore.named [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 16 08:38:28 devstack cinder-volume[91366]: WARNING castellan.key_manager [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 16 08:38:28 devstack cinder-volume[91366]: WARNING cinder.keymgr.conf_key_mgr [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 16 08:38:28 devstack cinder-volume[91366]: INFO cinder.volume.manager [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_db.sqlalchemy.engines [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91366) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 16 08:38:28 devstack cinder-volume[91366]: INFO oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Starting 1 workers Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Started child 91583 {{(pid=91366) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Full set of CONF: {{(pid=91366) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] ******************************************************************************** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Configuration options gathered from: {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] ================================================================================ {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] allow_availability_zone_fallback = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] allow_compression_on_image_upload = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] allowed_direct_url_schemes = [] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] api_rate_limit = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] auth_strategy = keystone {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_availability_zone = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_host = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_name = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_stats_polling_interval = 60 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backup_api_class = cinder.backup.api.API {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91583]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backup_name_template = backup-%s {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backup_use_same_host = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backup_use_temp_snapshot = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] chap_password = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] chap_username = {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cinder_internal_tenant_project_id = dfffa918307747d186b53f5280e849c0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cinder_internal_tenant_user_id = 6b14d1e710364427a2a7b00c8fcd9a1f {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cluster = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] compression_format = gzip {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] compute_api_class = cinder.compute.nova.API {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] config_dir = [] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] config_source = [] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] control_exchange = openstack {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] debug = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] default_availability_zone = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] default_group_type = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] default_volume_type = QuobyteHD {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] disk_geometry = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] driver_client_cert = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] driver_client_cert_key = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] driver_data_namespace = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] driver_ssl_cert_path = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] driver_ssl_cert_verify = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] driver_use_ssl = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] enable_new_services = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] enable_unsupported_driver = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] enabled_backends = ['QuobyteHD'] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] enforce_multipath_for_image_xfer = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] filter_function = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance_api_insecure = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance_api_servers = ['http://192.168.122.135/image'] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance_api_ssl_compression = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance_ca_certificates_file = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance_catalog_info = image:glance:publicURL {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance_certfile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance_keyfile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance_num_retries = 3 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance_request_timeout = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] goodness_function = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] graceful_shutdown_timeout = 5 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] group_api_class = cinder.group.api.API {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] host = devstack {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] image_compress_on_upload = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] image_conversion_address_space_limit = 1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] image_conversion_cpu_limit = 60 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] image_conversion_disable = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] image_upload_use_cinder_backend = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] image_upload_use_internal_tenant = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] image_volume_cache_enabled = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] image_volume_cache_max_count = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] image_volume_cache_max_size_gb = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] init_host_max_objects_retrieval = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] instance_format = [instance: %(uuid)s] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] iscsi_target_flags = {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] iscsi_write_cache = on {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] iser_helper = tgtadm {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] iser_ip_address = 192.168.122.135 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] iser_port = 3260 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] log_color = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] log_config_append = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] log_dir = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] log_file = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] log_options = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] log_rotate_interval = 1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] log_rotate_interval_type = days {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] log_rotation_type = none {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] max_age = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] max_logfile_count = 30 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] max_logfile_size_mb = 200 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] max_over_subscription_ratio = 20.0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] message_reap_interval = 86400 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] message_ttl = 2592000 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] migration_create_volume_timeout_secs = 300 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] monkey_patch = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] monkey_patch_modules = [] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] my_ip = 192.168.122.135 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] no_snapshot_gb_quota = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] num_iser_scan_tries = 3 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] num_shell_tries = 3 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] num_volume_device_scan_tries = 3 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] nvmeof_conn_info_version = 1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] nvmet_ns_id = 10 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] nvmet_port_id = 1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] osapi_max_limit = 1000 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] osapi_volume_ext_list = [] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] osapi_volume_listen_port = 8776 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] osapi_volume_use_ssl = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] osapi_volume_workers = 2 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] per_volume_size_limit = -1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] periodic_fuzzy_delay = 60 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] periodic_interval = 60 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] public_endpoint = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] publish_errors = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] quota_backup_gigabytes = 1000 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] quota_backups = 10 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] quota_gigabytes = 1000 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] quota_groups = 10 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] quota_snapshots = 10 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] quota_volumes = 10 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] rate_limit_burst = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] rate_limit_except_level = CRITICAL {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] rate_limit_interval = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] reinit_driver_count = 3 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] replication_device = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] report_discard_supported = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] report_interval = 120 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] reservation_clean_interval = 86400 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] reservation_expire = 86400 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] reserved_image_namespaces = [] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] reserved_percentage = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] rpc_response_timeout = 120 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] run_external_periodic_tasks = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] scst_target_driver = iscsi {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] scst_target_iqn_name = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] service_down_time = 720 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] shell_completion = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] snapshot_name_template = snapshot-%s {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] split_loggers = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] state_path = /opt/stack/data/cinder {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] storage_availability_zone = nova {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] storage_protocol = iSCSI {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] syslog_log_facility = LOG_USER {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] target_helper = lioadm {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] target_ip_address = 192.168.122.135 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91583]: INFO cinder.volume.manager [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] target_port = 3260 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] target_protocol = iscsi {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] target_secondary_ip_addresses = [] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] trace_flags = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] transport_url = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] until_refresh = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] use_chap_auth = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] use_default_quota_class = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] use_journal = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] use_json = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] use_multipath_for_image_xfer = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] use_stderr = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] use_syslog = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91583]: DEBUG cinder.volume.drivers.remotefs [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=91583) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] verify_glance_signatures = enabled {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] volume_api_class = cinder.volume.api.API {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] volume_backend_name = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] volume_clear = zero {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] volume_clear_ionice = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] volume_clear_size = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] volume_copy_bps_limit = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] volume_dd_blocksize = 1M {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] volume_name_template = volume-%s {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] volume_service_inithost_offload = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] volume_usage_audit_period = month {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] zoning_mode = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_concurrency.disable_process_locking = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.admin_password = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.admin_token = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.admin_user = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.auth_admin_prefix = {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.auth_port = 35357 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.auth_protocol = https {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.auth_section = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.auth_type = password {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.auth_uri = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.auth_version = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.cache = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.certfile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.identity_uri = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.include_service_catalog = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.insecure = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.interface = public {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.keyfile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.memcache_password = {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.memcache_username = {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.region_name = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.service_type = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.backend = dogpile.cache.null {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.backend_argument = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.backend_expiration_time = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.config_prefix = cache.oslo {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.debug_cache_backend = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.enable_retry_client = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.enable_socket_keepalive = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.enabled = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.enforce_fips_mode = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.expiration_time = 600 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.hashclient_retry_attempts = 2 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.memcache_dead_retry = 300 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.memcache_pool_maxsize = 10 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.memcache_sasl_enabled = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.password = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.proxies = [] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.redis_db = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.redis_server = localhost:6379 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.retry_attempts = 2 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.retry_delay = 0.0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.socket_keepalive_count = 1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.socket_keepalive_idle = 1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.socket_keepalive_interval = 1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.socket_timeout = 1.0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.tls_allowed_ciphers = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.tls_cafile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.tls_certfile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.tls_enabled = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.tls_keyfile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cache.username = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.asyncio_connection = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.asyncio_slave_connection = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.backend = sqlalchemy {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.connection = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.connection_debug = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.connection_parameters = {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.connection_recycle_time = 3600 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.connection_trace = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.db_inc_retry_interval = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.db_max_retries = 20 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.db_max_retry_interval = 10 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.db_retry_interval = 1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.max_overflow = 50 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.max_pool_size = 5 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.max_retries = 10 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.mysql_wsrep_sync_wait = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.pool_timeout = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.retry_interval = 10 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.slave_connection = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.sqlite_synchronous = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.synchronous_reader = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] database.use_db_reconnect = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] profiler.connection_string = messaging:// {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] profiler.enabled = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] profiler.es_doc_type = notification {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] profiler.es_scroll_size = 10000 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] profiler.es_scroll_time = 2m {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] profiler.filter_error_trace = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] profiler.hmac_keys = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] profiler.sentinel_service_name = mymaster {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] profiler.socket_timeout = 0.1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] profiler.trace_requests = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] profiler.trace_sqlalchemy = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] profiler_jaeger.process_tags = {} {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] profiler_jaeger.service_name_prefix = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] profiler_otlp.service_name_prefix = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_policy.enforce_new_defaults = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: WARNING oslo_config.cfg [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_policy.enforce_scope = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_policy.policy_default_rule = default {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_policy.policy_file = policy.yaml {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] coordination.backend_url = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] privsep_osbrick.group = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] privsep_osbrick.helper_command = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] privsep_osbrick.user = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cinder_sys_admin.group = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cinder_sys_admin.helper_command = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] cinder_sys_admin.user = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] service_user.auth_section = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] service_user.auth_type = password {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] service_user.cafile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] service_user.certfile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] service_user.collect_timing = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] service_user.insecure = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] service_user.keyfile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] service_user.send_service_user_token = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] service_user.split_loggers = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] service_user.timeout = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance.auth_section = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance.auth_type = password {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance.certfile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance.collect_timing = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance.insecure = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance.keyfile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance.region_name = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance.split_loggers = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] glance.timeout = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.backend_availability_zone = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.chap_password = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.chap_username = {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.disk_geometry = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.driver_client_cert = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.driver_client_cert_key = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.driver_data_namespace = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.driver_use_ssl = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.extra_capabilities = {} {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.filter_function = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.goodness_function = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.iscsi_target_flags = {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.iscsi_write_cache = on {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.iser_helper = tgtadm {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.iser_port = 3260 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.nas_host = {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.nas_login = admin {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.nas_mount_options = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.nas_password = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.nas_private_key = {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.nas_share_path = {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.num_shell_tries = 3 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91583]: DEBUG cinder.volume.drivers.quobyte [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=91583) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 16 08:38:28 devstack cinder-volume[91583]: WARNING cinder.volume.drivers.quobyte [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 16 08:38:28 devstack cinder-volume[91583]: WARNING cinder.volume.drivers.quobyte [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.quobyte_volume_url = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.replication_device = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.report_discard_supported = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.reserved_percentage = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91583]: DEBUG oslo_concurrency.processutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Running cmd (subprocess): mount.quobyte {{(pid=91583) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.target_helper = tgtadm {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.target_port = 3260 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.target_protocol = iscsi {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.trace_flags = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.unique_fqdn_network = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.use_chap_auth = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.volume_backend_name = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.volume_clear = zero {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.volume_clear_ionice = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.volume_clear_size = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_reports.file_event_handler = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_reports.log_dir = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.backend_availability_zone = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.backend_host = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.chap_password = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.chap_username = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.chiscsi_conf = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.disk_geometry = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.driver_client_cert = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.driver_data_namespace = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.driver_use_ssl = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.extra_capabilities = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.filter_function = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.goodness_function = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.iser_helper = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.iser_ip_address = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.iser_port = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.iser_target_prefix = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.nas_host = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.nas_login = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.nas_mount_options = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.nas_password = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.nas_private_key = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.nas_share_path = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.nas_ssh_port = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.num_shell_tries = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.nvmet_port_id = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.replication_device = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.report_discard_supported = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.reserved_percentage = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.scst_target_driver = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.storage_protocol = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.target_helper = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.target_ip_address = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.target_port = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.target_prefix = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.target_protocol = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.trace_flags = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.use_chap_auth = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.volume_clear = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.volume_clear_size = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] QuobyteHD.volumes_dir = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack quobyte-client[91586]: Reading configuration file: /etc/quobyte/client.cfg Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack quobyte-client[91586]: Invalid parameters found, error: missing mount point. Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack quobyte-client[91586]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack quobyte-client[91586]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.ssl = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_notifications.driver = [] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_notifications.retry = -1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] key_manager.fixed_key = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican.barbican_api_version = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican.barbican_endpoint = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican.barbican_endpoint_type = public {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican.barbican_region_name = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican.cafile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican.certfile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican.collect_timing = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican.insecure = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican.keyfile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican.number_of_retries = 60 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican.retry_delay = 1 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican.send_service_user_token = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican.split_loggers = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican.timeout = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican.verify_ssl = True {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican.verify_ssl_path = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican_service_user.auth_section = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican_service_user.auth_type = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican_service_user.cafile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican_service_user.certfile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican_service_user.collect_timing = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican_service_user.insecure = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican_service_user.keyfile = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican_service_user.split_loggers = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] barbican_service_user.timeout = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] vault.approle_role_id = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] vault.approle_secret_id = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] vault.kv_mountpoint = secret {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] vault.kv_path = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] vault.kv_version = 2 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] vault.namespace = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] vault.root_token_id = **** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] vault.ssl_ca_crt_file = None {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] vault.timeout = 60.0 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] vault.use_ssl = False {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:28 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] ******************************************************************************** {{(pid=91366) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 16 08:38:28 devstack cinder-volume[91583]: DEBUG oslo_concurrency.processutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] CMD "mount.quobyte" returned: 1 in 0.135s {{(pid=91583) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:38:28 devstack cinder-volume[91583]: DEBUG oslo_concurrency.lockutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91583) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:38:28 devstack cinder-volume[91583]: DEBUG oslo_concurrency.lockutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91583) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:38:28 devstack cinder-volume[91583]: DEBUG cinder.volume.drivers.quobyte [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=91583) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:38:28 devstack cinder-volume[91583]: INFO cinder.volume.drivers.quobyte [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 ... Jun 16 08:38:28 devstack cinder-volume[91583]: DEBUG oslo_concurrency.processutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 -c /etc/quobyte/client-cinder.cfg {{(pid=91583) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:38:28 devstack sudo[91589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 -c /etc/quobyte/client-cinder.cfg Jun 16 08:38:28 devstack sudo[91589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:38:29 devstack sudo[91589]: pam_unix(sudo:session): session closed for user root Jun 16 08:38:29 devstack cinder-volume[91583]: DEBUG oslo_concurrency.processutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.769s {{(pid=91583) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:38:29 devstack cinder-volume[91583]: INFO cinder.volume.drivers.quobyte [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 succeeded Jun 16 08:38:29 devstack cinder-volume[91583]: DEBUG cinder.volume.drivers.quobyte [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=91583) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:38:29 devstack cinder-volume[91583]: DEBUG oslo_concurrency.lockutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.785s {{(pid=91583) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:38:29 devstack cinder-volume[91583]: DEBUG oslo_concurrency.processutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=91583) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:38:29 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:38:29 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:38:30 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Jun 16 08:38:30 devstack cinder-volume[91583]: DEBUG oslo_concurrency.processutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.603s {{(pid=91583) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:38:30 devstack cinder-volume[91583]: INFO cinder.volume.driver [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Driver hasn't implemented _init_vendor_properties() Jun 16 08:38:30 devstack cinder-volume[91583]: DEBUG cinder.volume.driver [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578506469727, 'free_capacity_gb': 1775.7578506469727, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91583) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 16 08:38:30 devstack cinder-volume[91583]: DEBUG oslo_db.sqlalchemy.engines [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91583) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 16 08:38:30 devstack cinder-volume[91583]: DEBUG dbcounter [-] [91583] Writer thread running {{(pid=91583) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 16 08:38:30 devstack cinder-volume[91583]: DEBUG cinder.db.sqlalchemy.api [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Building query based on filter {{(pid=91583) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 16 08:38:30 devstack cinder-volume[91583]: DEBUG cinder.image.image_utils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=91583) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 16 08:38:30 devstack cinder-volume[91583]: INFO cinder.keymgr.migration [None req-9bf6b9a3-34e0-4f30-ad93-06d60f1cff98 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 16 08:38:30 devstack cinder-volume[91583]: DEBUG oslo_concurrency.lockutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91583) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:38:30 devstack cinder-volume[91583]: DEBUG oslo_concurrency.lockutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91583) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:38:30 devstack cinder-volume[91583]: DEBUG cinder.volume.drivers.quobyte [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=91583) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:38:30 devstack cinder-volume[91583]: DEBUG cinder.volume.drivers.quobyte [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=91583) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:38:30 devstack cinder-volume[91583]: DEBUG oslo_concurrency.lockutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91583) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:38:30 devstack cinder-volume[91583]: DEBUG oslo_concurrency.processutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=91583) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:38:30 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:38:30 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:38:30 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Jun 16 08:38:30 devstack cinder-volume[91583]: DEBUG oslo_concurrency.processutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.583s {{(pid=91583) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:38:30 devstack cinder-volume[91583]: DEBUG cinder.manager [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Notifying Schedulers of capabilities ... {{(pid=91583) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:38:30 devstack cinder-volume[91583]: INFO cinder.volume.manager [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Driver initialization completed successfully. Jun 16 08:38:30 devstack cinder-volume[91583]: INFO cinder.manager [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Initiating service 3 cleanup Jun 16 08:38:30 devstack cinder-volume[91583]: INFO cinder.manager [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Service 3 cleanup completed. Jun 16 08:38:30 devstack cinder-volume[91583]: DEBUG cinder.service [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Creating RPC server for service cinder-volume {{(pid=91583) start /opt/stack/cinder/cinder/service.py:231}} Jun 16 08:38:30 devstack cinder-volume[91583]: DEBUG cinder.service [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=91583) start /opt/stack/cinder/cinder/service.py:237}} Jun 16 08:38:31 devstack cinder-volume[91583]: INFO cinder.volume.manager [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 16 08:38:31 devstack cinder-volume[91583]: DEBUG oslo_concurrency.lockutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91583) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:38:31 devstack cinder-volume[91583]: DEBUG oslo_concurrency.lockutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91583) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:38:31 devstack cinder-volume[91583]: DEBUG cinder.volume.drivers.quobyte [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=91583) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:38:31 devstack cinder-volume[91583]: DEBUG cinder.volume.drivers.quobyte [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=91583) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:38:31 devstack cinder-volume[91583]: DEBUG oslo_concurrency.lockutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91583) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:38:31 devstack cinder-volume[91583]: DEBUG oslo_concurrency.processutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=91583) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:38:31 devstack sudo[91669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:38:31 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:38:31 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root Jun 16 08:38:31 devstack cinder-volume[91583]: DEBUG oslo_concurrency.processutils [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.592s {{(pid=91583) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:38:31 devstack cinder-volume[91583]: INFO cinder.volume.manager [None req-7bfdf919-74b6-408a-b41b-0677413b38b4 None None] Driver post RPC initialization completed successfully. Jun 16 08:38:36 devstack cinder-volume[91583]: DEBUG oslo_concurrency.lockutils [None req-7790b646-5c42-4559-bac5-99e9d1986140 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91583) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:38:36 devstack cinder-volume[91583]: DEBUG oslo_concurrency.lockutils [None req-7790b646-5c42-4559-bac5-99e9d1986140 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91583) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:38:36 devstack cinder-volume[91583]: DEBUG cinder.volume.drivers.quobyte [None req-7790b646-5c42-4559-bac5-99e9d1986140 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=91583) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:38:36 devstack cinder-volume[91583]: DEBUG cinder.volume.drivers.quobyte [None req-7790b646-5c42-4559-bac5-99e9d1986140 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=91583) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:38:36 devstack cinder-volume[91583]: DEBUG oslo_concurrency.lockutils [None req-7790b646-5c42-4559-bac5-99e9d1986140 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91583) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:38:36 devstack cinder-volume[91583]: DEBUG oslo_concurrency.processutils [None req-7790b646-5c42-4559-bac5-99e9d1986140 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=91583) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:38:36 devstack sudo[91851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:38:36 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:38:36 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root Jun 16 08:38:36 devstack cinder-volume[91583]: DEBUG oslo_concurrency.processutils [None req-7790b646-5c42-4559-bac5-99e9d1986140 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.564s {{(pid=91583) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:38:36 devstack cinder-volume[91583]: DEBUG cinder.manager [None req-7790b646-5c42-4559-bac5-99e9d1986140 None None] Notifying Schedulers of capabilities ... {{(pid=91583) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:38:38 devstack cinder-volume[91366]: DEBUG dbcounter [-] [91366] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=91366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:38:39 devstack cinder-volume[91366]: INFO oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Caught SIGTERM, stopping children Jun 16 08:38:39 devstack cinder-volume[91366]: DEBUG oslo_concurrency.lockutils [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Acquiring lock "singleton_lock" {{(pid=91366) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 16 08:38:39 devstack cinder-volume[91366]: DEBUG oslo_concurrency.lockutils [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Acquired lock "singleton_lock" {{(pid=91366) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 16 08:38:39 devstack cinder-volume[91366]: DEBUG oslo_concurrency.lockutils [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Releasing lock "singleton_lock" {{(pid=91366) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 16 08:38:39 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Stop services. {{(pid=91366) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 16 08:38:39 devstack cinder-volume[91366]: DEBUG oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Killing children. {{(pid=91366) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 16 08:38:39 devstack cinder-volume[91366]: INFO oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Waiting on 1 children to exit Jun 16 08:38:40 devstack cinder-volume[91583]: DEBUG dbcounter [-] [91583] Writing DB stats cinder:SELECT=3 {{(pid=91583) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:38:41 devstack cinder-volume[91583]: DEBUG dbcounter [-] [91583] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=91583) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:38:44 devstack cinder-volume[91583]: DEBUG oslo_concurrency.lockutils [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Acquiring lock "singleton_lock" {{(pid=91583) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 16 08:38:44 devstack cinder-volume[91583]: DEBUG oslo_concurrency.lockutils [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Acquired lock "singleton_lock" {{(pid=91583) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 16 08:38:44 devstack cinder-volume[91583]: DEBUG oslo_concurrency.lockutils [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Releasing lock "singleton_lock" {{(pid=91583) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 16 08:38:44 devstack cinder-volume[91583]: WARNING amqp [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 16 08:38:44 devstack cinder-volume[91583]: WARNING amqp [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 16 08:38:44 devstack cinder-volume[91366]: INFO oslo_service.backend._eventlet.service [None req-0fc40ba2-6afa-462a-848c-eac40eaaa8d3 None None] Child 91583 exited with status 0 Jun 16 08:38:47 devstack cinder-volume[92074]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92074) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 16 08:38:47 devstack cinder-volume[92074]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92074) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 16 08:38:47 devstack cinder-volume[92074]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92074) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 16 08:38:48 devstack cinder-volume[92074]: INFO dbcounter [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] Registered counter for database cinder Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_db.sqlalchemy.engines [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92074) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG dbcounter [-] [92074] Writer thread running {{(pid=92074) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 16 08:38:48 devstack cinder-volume[92074]: INFO cinder.rpc [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 16 08:38:48 devstack cinder-volume[92074]: INFO cinder.rpc [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_db.sqlalchemy.engines [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92074) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 16 08:38:48 devstack cinder-volume[92074]: INFO cinder.volume.manager [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] Determined volume DB was empty at startup. Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG cinder.volume.manager [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92074) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 16 08:38:48 devstack cinder-volume[92074]: WARNING stevedore.named [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 16 08:38:48 devstack cinder-volume[92074]: WARNING castellan.key_manager [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 16 08:38:48 devstack cinder-volume[92074]: WARNING cinder.keymgr.conf_key_mgr [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 16 08:38:48 devstack cinder-volume[92074]: INFO cinder.volume.manager [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_db.sqlalchemy.engines [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92074) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 16 08:38:48 devstack cinder-volume[92074]: INFO oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] Starting 1 workers Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] Started child 92348 {{(pid=92074) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] Full set of CONF: {{(pid=92074) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] ******************************************************************************** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] Configuration options gathered from: {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] ================================================================================ {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] allow_availability_zone_fallback = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] allow_compression_on_image_upload = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] allowed_direct_url_schemes = [] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] api_rate_limit = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] auth_strategy = keystone {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_availability_zone = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_host = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_name = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_stats_polling_interval = 60 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backup_api_class = cinder.backup.api.API {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backup_name_template = backup-%s {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backup_use_same_host = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backup_use_temp_snapshot = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] chap_password = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] chap_username = {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cinder_internal_tenant_project_id = dfffa918307747d186b53f5280e849c0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cinder_internal_tenant_user_id = 6b14d1e710364427a2a7b00c8fcd9a1f {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cluster = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] compression_format = gzip {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] compute_api_class = cinder.compute.nova.API {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] config_dir = [] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] config_source = [] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] control_exchange = openstack {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] debug = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] default_availability_zone = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:48 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] default_group_type = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] default_volume_type = QuobyteHD {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] disk_geometry = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] driver_client_cert = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] driver_client_cert_key = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] driver_data_namespace = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92348]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] driver_ssl_cert_path = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] driver_ssl_cert_verify = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] driver_use_ssl = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] enable_new_services = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] enable_unsupported_driver = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] enabled_backends = ['QuobyteHD'] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] enforce_multipath_for_image_xfer = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] filter_function = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance_api_insecure = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance_api_servers = ['http://192.168.122.135/image'] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance_api_ssl_compression = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance_ca_certificates_file = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance_catalog_info = image:glance:publicURL {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance_certfile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance_keyfile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance_num_retries = 3 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance_request_timeout = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] goodness_function = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] graceful_shutdown_timeout = 5 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] group_api_class = cinder.group.api.API {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] host = devstack {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] image_compress_on_upload = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] image_conversion_address_space_limit = 1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] image_conversion_cpu_limit = 60 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] image_conversion_disable = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] image_upload_use_cinder_backend = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] image_upload_use_internal_tenant = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] image_volume_cache_enabled = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] image_volume_cache_max_count = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] image_volume_cache_max_size_gb = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] init_host_max_objects_retrieval = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] instance_format = [instance: %(uuid)s] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] iscsi_target_flags = {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] iscsi_write_cache = on {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] iser_helper = tgtadm {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] iser_ip_address = 192.168.122.135 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] iser_port = 3260 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] log_color = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] log_config_append = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] log_dir = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] log_file = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] log_options = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] log_rotate_interval = 1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] log_rotate_interval_type = days {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] log_rotation_type = none {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] max_age = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] max_logfile_count = 30 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] max_logfile_size_mb = 200 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] max_over_subscription_ratio = 20.0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] message_reap_interval = 86400 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] message_ttl = 2592000 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] migration_create_volume_timeout_secs = 300 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] monkey_patch = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] monkey_patch_modules = [] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] my_ip = 192.168.122.135 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] no_snapshot_gb_quota = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] num_iser_scan_tries = 3 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] num_shell_tries = 3 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] num_volume_device_scan_tries = 3 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] nvmeof_conn_info_version = 1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] nvmet_ns_id = 10 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] nvmet_port_id = 1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] osapi_max_limit = 1000 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] osapi_volume_ext_list = [] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] osapi_volume_listen_port = 8776 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] osapi_volume_use_ssl = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] osapi_volume_workers = 2 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] per_volume_size_limit = -1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] periodic_fuzzy_delay = 60 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] periodic_interval = 60 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] public_endpoint = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] publish_errors = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] quota_backup_gigabytes = 1000 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] quota_backups = 10 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] quota_gigabytes = 1000 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] quota_groups = 10 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] quota_snapshots = 10 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] quota_volumes = 10 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] rate_limit_burst = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] rate_limit_except_level = CRITICAL {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] rate_limit_interval = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] reinit_driver_count = 3 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] replication_device = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] report_discard_supported = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] report_interval = 120 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] reservation_clean_interval = 86400 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] reservation_expire = 86400 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] reserved_image_namespaces = [] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] reserved_percentage = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] rpc_response_timeout = 120 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] run_external_periodic_tasks = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] scst_target_driver = iscsi {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] scst_target_iqn_name = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] service_down_time = 720 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] shell_completion = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] snapshot_name_template = snapshot-%s {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] split_loggers = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] state_path = /opt/stack/data/cinder {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] storage_availability_zone = nova {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] storage_protocol = iSCSI {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] syslog_log_facility = LOG_USER {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] target_helper = lioadm {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] target_ip_address = 192.168.122.135 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] target_port = 3260 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] target_protocol = iscsi {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] target_secondary_ip_addresses = [] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] trace_flags = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] transport_url = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] until_refresh = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] use_chap_auth = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] use_default_quota_class = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] use_journal = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] use_json = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] use_multipath_for_image_xfer = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] use_stderr = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] use_syslog = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] verify_glance_signatures = enabled {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] volume_api_class = cinder.volume.api.API {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] volume_backend_name = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] volume_clear = zero {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] volume_clear_ionice = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92348) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] volume_clear_size = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] volume_copy_bps_limit = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] volume_dd_blocksize = 1M {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] volume_name_template = volume-%s {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] volume_service_inithost_offload = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] volume_usage_audit_period = month {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] zoning_mode = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_concurrency.disable_process_locking = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.admin_password = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.admin_token = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.admin_user = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.auth_admin_prefix = {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.auth_port = 35357 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.auth_protocol = https {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.auth_section = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.auth_type = password {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.auth_uri = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.auth_version = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.cache = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.certfile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.identity_uri = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.include_service_catalog = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.insecure = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.interface = public {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.keyfile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.memcache_password = {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.memcache_username = {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.region_name = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.service_token_roles_required = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.service_type = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.backend = dogpile.cache.null {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.backend_argument = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.backend_expiration_time = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.config_prefix = cache.oslo {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.debug_cache_backend = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.enable_retry_client = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.enable_socket_keepalive = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.enabled = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.enforce_fips_mode = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.expiration_time = 600 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.hashclient_retry_attempts = 2 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.memcache_dead_retry = 300 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.memcache_pool_maxsize = 10 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.memcache_sasl_enabled = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.password = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.proxies = [] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.redis_db = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.redis_server = localhost:6379 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.retry_attempts = 2 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.retry_delay = 0.0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.socket_keepalive_count = 1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.socket_keepalive_idle = 1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.socket_keepalive_interval = 1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.socket_timeout = 1.0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.tls_allowed_ciphers = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.tls_cafile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.tls_certfile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.tls_enabled = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.tls_keyfile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cache.username = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.asyncio_connection = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.asyncio_slave_connection = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.backend = sqlalchemy {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.connection = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.connection_debug = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.connection_parameters = {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.connection_recycle_time = 3600 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.connection_trace = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.db_inc_retry_interval = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.db_max_retries = 20 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.db_max_retry_interval = 10 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.db_retry_interval = 1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.max_overflow = 50 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.max_pool_size = 5 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.max_retries = 10 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.mysql_wsrep_sync_wait = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.pool_timeout = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.retry_interval = 10 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.slave_connection = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.sqlite_synchronous = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.synchronous_reader = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] database.use_db_reconnect = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] profiler.connection_string = messaging:// {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] profiler.enabled = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] profiler.es_doc_type = notification {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] profiler.es_scroll_size = 10000 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] profiler.es_scroll_time = 2m {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] profiler.filter_error_trace = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] profiler.hmac_keys = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] profiler.sentinel_service_name = mymaster {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] profiler.socket_timeout = 0.1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] profiler.trace_requests = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] profiler.trace_sqlalchemy = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] profiler_jaeger.process_tags = {} {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] profiler_jaeger.service_name_prefix = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] profiler_otlp.service_name_prefix = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_policy.enforce_new_defaults = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92348) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 16 08:38:49 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.quobyte [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 16 08:38:49 devstack cinder-volume[92074]: WARNING oslo_config.cfg [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_policy.enforce_scope = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_policy.policy_default_rule = default {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_policy.policy_file = policy.yaml {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.quobyte [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Running cmd (subprocess): mount.quobyte {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] coordination.backend_url = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] privsep_osbrick.group = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] privsep_osbrick.helper_command = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] privsep_osbrick.user = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cinder_sys_admin.group = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cinder_sys_admin.helper_command = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] cinder_sys_admin.user = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] service_user.auth_section = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] service_user.auth_type = password {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] service_user.cafile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] service_user.certfile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] service_user.collect_timing = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] service_user.insecure = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] service_user.keyfile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] service_user.send_service_user_token = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] service_user.split_loggers = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] service_user.timeout = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance.auth_section = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance.auth_type = password {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance.certfile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance.collect_timing = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance.insecure = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance.keyfile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance.region_name = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance.split_loggers = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] glance.timeout = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.backend_availability_zone = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.chap_password = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.chap_username = {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.disk_geometry = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.driver_client_cert = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.driver_client_cert_key = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.driver_data_namespace = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.driver_use_ssl = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.extra_capabilities = {} {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.filter_function = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.goodness_function = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.iscsi_target_flags = {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.iscsi_write_cache = on {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.iser_helper = tgtadm {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.iser_port = 3260 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.nas_host = {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.nas_login = admin {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.nas_mount_options = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.nas_password = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.nas_private_key = {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.nas_share_path = {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.num_shell_tries = 3 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.quobyte_volume_url = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.replication_device = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.report_discard_supported = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.reserved_percentage = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.target_helper = tgtadm {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.target_port = 3260 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.target_protocol = iscsi {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.trace_flags = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.unique_fqdn_network = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.use_chap_auth = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.volume_backend_name = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.volume_clear = zero {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.volume_clear_ionice = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.volume_clear_size = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_reports.file_event_handler = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_reports.log_dir = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.backend_availability_zone = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.backend_host = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.chap_password = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.chap_username = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.chiscsi_conf = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.disk_geometry = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.driver_client_cert = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.driver_data_namespace = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.driver_use_ssl = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.extra_capabilities = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.filter_function = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.goodness_function = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.iser_helper = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.iser_ip_address = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.iser_port = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.iser_target_prefix = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.nas_host = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.nas_login = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.nas_mount_options = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.nas_password = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.nas_private_key = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.nas_share_path = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.nas_ssh_port = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.num_shell_tries = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack quobyte-client[92349]: Reading configuration file: /etc/quobyte/client.cfg Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.nvmet_port_id = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack quobyte-client[92349]: Invalid parameters found, error: missing mount point. Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.replication_device = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack quobyte-client[92349]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.report_discard_supported = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.reserved_percentage = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.scst_target_driver = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack quobyte-client[92349]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.storage_protocol = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.target_helper = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.target_ip_address = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.target_port = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.target_prefix = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.target_protocol = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.trace_flags = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.use_chap_auth = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.volume_clear = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.volume_clear_size = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] QuobyteHD.volumes_dir = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.ssl = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_notifications.driver = [] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_notifications.retry = -1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] key_manager.fixed_key = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican.barbican_api_version = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican.barbican_endpoint = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican.barbican_endpoint_type = public {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican.barbican_region_name = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican.cafile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican.certfile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican.collect_timing = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican.insecure = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican.keyfile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican.number_of_retries = 60 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican.retry_delay = 1 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican.send_service_user_token = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican.split_loggers = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican.timeout = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican.verify_ssl = True {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican.verify_ssl_path = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican_service_user.auth_section = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican_service_user.auth_type = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican_service_user.cafile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican_service_user.certfile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican_service_user.collect_timing = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican_service_user.insecure = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican_service_user.keyfile = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican_service_user.split_loggers = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] barbican_service_user.timeout = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] vault.approle_role_id = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] vault.approle_secret_id = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] vault.kv_mountpoint = secret {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] vault.kv_path = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] vault.kv_version = 2 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] vault.namespace = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] vault.root_token_id = **** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] vault.ssl_ca_crt_file = None {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] vault.timeout = 60.0 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] vault.use_ssl = False {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 16 08:38:49 devstack cinder-volume[92074]: DEBUG oslo_service.backend._eventlet.service [None req-a4105a1d-89dd-4dbb-ba74-eedd3ea07e20 None None] ******************************************************************************** {{(pid=92074) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 16 08:38:49 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:38:49 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:38:49 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.575s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:38:49 devstack cinder-volume[92348]: INFO cinder.volume.driver [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Driver hasn't implemented _init_vendor_properties() Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG cinder.volume.driver [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578506469727, 'free_capacity_gb': 1775.7578506469727, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92348) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG oslo_db.sqlalchemy.engines [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92348) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writer thread running {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG cinder.db.sqlalchemy.api [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Building query based on filter {{(pid=92348) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92348) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:38:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:38:49 devstack cinder-volume[92348]: INFO cinder.keymgr.migration [None req-b4b3a329-5371-40e7-8b2b-72e1b475c0bc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 16 08:38:49 devstack sudo[92380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:38:49 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:38:50 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root Jun 16 08:38:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.579s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:38:50 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:38:50 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Driver initialization completed successfully. Jun 16 08:38:50 devstack cinder-volume[92348]: INFO cinder.manager [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Initiating service 3 cleanup Jun 16 08:38:50 devstack cinder-volume[92348]: INFO cinder.manager [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Service 3 cleanup completed. Jun 16 08:38:50 devstack cinder-volume[92348]: DEBUG cinder.service [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Creating RPC server for service cinder-volume {{(pid=92348) start /opt/stack/cinder/cinder/service.py:231}} Jun 16 08:38:50 devstack cinder-volume[92348]: DEBUG cinder.service [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92348) start /opt/stack/cinder/cinder/service.py:237}} Jun 16 08:38:50 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 16 08:38:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:38:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:38:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:38:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:38:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:38:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:38:50 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:38:50 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:38:51 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Jun 16 08:38:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.546s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:38:51 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-a2753d41-5e31-436a-b25d-21ecf25bb139 None None] Driver post RPC initialization completed successfully. Jun 16 08:38:58 devstack cinder-volume[92074]: DEBUG dbcounter [-] [92074] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=92074) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:39:00 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:39:01 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=4 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:39:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:39:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 6 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:39:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Flow 'volume_create_manager' (f74876f2-c5bc-4d6d-b9c4-94d122ea0125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e056e87d-cd62-425a-9bca-ba656a6e4206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e056e87d-cd62-425a-9bca-ba656a6e4206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2147029613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71500bbb-c82a-4e08-b7d2-0ae2b2f6387c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e15e05cf75843f8bdde74729821e537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:39:48Z,use_quota=True,user_id='98ffbc38ffa544ec861c4d774e43edd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8410beef-24cd-44f8-b867-a4191be119fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8410beef-24cd-44f8-b867-a4191be119fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6cda053-a304-4b52-a3d8-047235802b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6cda053-a304-4b52-a3d8-047235802b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71500bbb-c82a-4e08-b7d2-0ae2b2f6387c', 'volume_name': 'volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fce94b3-3761-4c7d-adb6-f1ef08b28b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fce94b3-3761-4c7d-adb6-f1ef08b28b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd2dfe1-5fac-4731-ac97-0f9d9e1ddc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:39:47 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Volume 71500bbb-c82a-4e08-b7d2-0ae2b2f6387c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c', 'volume_size': 1} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2147029613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71500bbb-c82a-4e08-b7d2-0ae2b2f6387c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e15e05cf75843f8bdde74729821e537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:39:48Z,use_quota=True,user_id='98ffbc38ffa544ec861c4d774e43edd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Creating volume 71500bbb-c82a-4e08-b7d2-0ae2b2f6387c {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:39:47 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:39:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:39:48 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c 1073741824 Jun 16 08:39:48 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:39:49 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Jun 16 08:39:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c 1073741824" returned: 0 in 1.039s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:39:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:39:49 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c Jun 16 08:39:49 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:39:49 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Jun 16 08:39:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c" returned: 0 in 0.686s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:39:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:39:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:39:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd2dfe1-5fac-4731-ac97-0f9d9e1ddc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:39:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d9f407-d615-4512-85c9-4614c05ad880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:39:49 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Volume volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c (71500bbb-c82a-4e08-b7d2-0ae2b2f6387c): created successfully Jun 16 08:39:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d9f407-d615-4512-85c9-4614c05ad880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:39:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Flow 'volume_create_manager' (f74876f2-c5bc-4d6d-b9c4-94d122ea0125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:39:49 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-5694b68c-a8c9-4553-8934-81b58871e2e8 tempest-TaggedAttachmentsTest-1811367975 None] Created volume successfully. Jun 16 08:39:59 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:39:59 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:40:20 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:40:20 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Flow 'volume_create_manager' (9a68939f-8e28-43f0-8415-329d135a11a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:40:20 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f8e5f44-dd39-4057-ad8e-cb05af964fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:40:20 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f8e5f44-dd39-4057-ad8e-cb05af964fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-66679785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e6adf2-02b5-4a0f-997f-6cec76886b52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09e71013b4e543388196628816437994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:40:21Z,use_quota=True,user_id='dcc61c240d334a88a61191fb7534abf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a52ac7a-d323-435b-b610-9c426629ac62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a52ac7a-d323-435b-b610-9c426629ac62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef4011b-1074-4eea-a75c-a6d5a345c900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef4011b-1074-4eea-a75c-a6d5a345c900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e6adf2-02b5-4a0f-997f-6cec76886b52', 'volume_name': 'volume-a2e6adf2-02b5-4a0f-997f-6cec76886b52', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8357fc6-dd3d-45de-81c5-60c797561992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8357fc6-dd3d-45de-81c5-60c797561992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019a6484-4add-44e1-89f7-ffdd2130d957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:40:21 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Volume a2e6adf2-02b5-4a0f-997f-6cec76886b52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e6adf2-02b5-4a0f-997f-6cec76886b52', 'volume_size': 1} Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-66679785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e6adf2-02b5-4a0f-997f-6cec76886b52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09e71013b4e543388196628816437994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:40:21Z,use_quota=True,user_id='dcc61c240d334a88a61191fb7534abf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Creating volume a2e6adf2-02b5-4a0f-997f-6cec76886b52 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:40:21 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:40:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a2e6adf2-02b5-4a0f-997f-6cec76886b52 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:40:21 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a2e6adf2-02b5-4a0f-997f-6cec76886b52 1073741824 Jun 16 08:40:21 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:40:23 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Jun 16 08:40:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a2e6adf2-02b5-4a0f-997f-6cec76886b52 1073741824" returned: 0 in 2.616s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:40:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a2e6adf2-02b5-4a0f-997f-6cec76886b52 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:40:23 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a2e6adf2-02b5-4a0f-997f-6cec76886b52 Jun 16 08:40:23 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:40:25 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Jun 16 08:40:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a2e6adf2-02b5-4a0f-997f-6cec76886b52" returned: 0 in 1.280s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:40:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] <== create_volume: return (3990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:40:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:40:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019a6484-4add-44e1-89f7-ffdd2130d957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e6adf2-02b5-4a0f-997f-6cec76886b52', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:40:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c66bdb-0c2f-4431-abb5-c60e15937cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:40:25 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Volume volume-a2e6adf2-02b5-4a0f-997f-6cec76886b52 (a2e6adf2-02b5-4a0f-997f-6cec76886b52): created successfully Jun 16 08:40:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c66bdb-0c2f-4431-abb5-c60e15937cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:40:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Flow 'volume_create_manager' (9a68939f-8e28-43f0-8415-329d135a11a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:40:25 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-9d528866-2418-4cd5-a1c7-1b5fd0f4be61 tempest-VolumesAdminNegativeTest-399392069 None] Created volume successfully. Jun 16 08:40:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Acquiring lock "cinder-a2e6adf2-02b5-4a0f-997f-6cec76886b52-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:40:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Lock "cinder-a2e6adf2-02b5-4a0f-997f-6cec76886b52-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:40:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Acquiring lock "cinder-quobyte-a2e6adf2-02b5-4a0f-997f-6cec76886b52" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:40:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Lock "cinder-quobyte-a2e6adf2-02b5-4a0f-997f-6cec76886b52" acquired by "delete_volume" :: waited 0.048s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:40:27 devstack cinder-volume[92348]: INFO oslo.privsep.daemon [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8m_ql4k0/privsep.sock'] Jun 16 08:40:27 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8m_ql4k0/privsep.sock Jun 16 08:40:27 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:40:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:40:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:40:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:40:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:40:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:40:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:40:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:40:30 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:40:30 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:40:31 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Jun 16 08:40:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.310s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:40:31 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:40:31 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:40:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 7 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:40:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:40:32 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Jun 16 08:40:32 devstack cinder-volume[92348]: INFO oslo.privsep.daemon [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Spawned new privsep daemon via rootwrap Jun 16 08:40:32 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Accepted privsep connection to /tmp/tmp8m_ql4k0/privsep.sock {{(pid=92348) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Jun 16 08:40:32 devstack cinder-volume[92348]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 16 08:40:32 devstack cinder-volume[92348]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 16 08:40:32 devstack cinder-volume[92348]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 16 08:40:32 devstack cinder-volume[92348]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 93408 Jun 16 08:40:32 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8879874-151c-4591-ad2d-54ab72d3ce5c]: (2,) {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:40:32 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[286c6ab9-80c6-453f-a4bc-17541b19519f]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:40:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a2e6adf2-02b5-4a0f-997f-6cec76886b52 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:40:32 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a2e6adf2-02b5-4a0f-997f-6cec76886b52 Jun 16 08:40:32 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Flow 'volume_create_manager' (58a89736-6815-48cd-9a2c-86d85ec8e6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e61ff55-93ee-4a6d-8ad6-3e5a10b4587a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e61ff55-93ee-4a6d-8ad6-3e5a10b4587a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1319033805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8779006b-b00a-4b5e-9fb9-5c4902063838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ff99bfee5b4cf9a0665da6e4772da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:40:33Z,use_quota=True,user_id='9bb58a9ab49a4bc59ca57e98c124e5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb9500d-b0b6-4807-8cbf-19b861051ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb9500d-b0b6-4807-8cbf-19b861051ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae2eeff-4500-4b31-9c81-46707f94ad5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae2eeff-4500-4b31-9c81-46707f94ad5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8779006b-b00a-4b5e-9fb9-5c4902063838', 'volume_name': 'volume-8779006b-b00a-4b5e-9fb9-5c4902063838', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c35a82-2130-43c3-86a9-e3dd7d4409d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c35a82-2130-43c3-86a9-e3dd7d4409d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4c513c-9344-42a0-8a4a-4890bf726e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:40:33 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Volume 8779006b-b00a-4b5e-9fb9-5c4902063838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8779006b-b00a-4b5e-9fb9-5c4902063838', 'volume_size': 1} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1319033805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8779006b-b00a-4b5e-9fb9-5c4902063838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0ff99bfee5b4cf9a0665da6e4772da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:40:33Z,use_quota=True,user_id='9bb58a9ab49a4bc59ca57e98c124e5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Creating volume 8779006b-b00a-4b5e-9fb9-5c4902063838 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:40:33 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:40:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8779006b-b00a-4b5e-9fb9-5c4902063838 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:40:33 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8779006b-b00a-4b5e-9fb9-5c4902063838 1073741824 Jun 16 08:40:33 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:40:34 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Jun 16 08:40:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a2e6adf2-02b5-4a0f-997f-6cec76886b52" returned: 0 in 1.944s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:40:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a2e6adf2-02b5-4a0f-997f-6cec76886b52 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:40:34 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a2e6adf2-02b5-4a0f-997f-6cec76886b52 Jun 16 08:40:34 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:40:35 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Jun 16 08:40:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8779006b-b00a-4b5e-9fb9-5c4902063838 1073741824" returned: 0 in 1.904s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:40:35 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Jun 16 08:40:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8779006b-b00a-4b5e-9fb9-5c4902063838 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:40:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a2e6adf2-02b5-4a0f-997f-6cec76886b52" returned: 0 in 1.228s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:40:35 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8779006b-b00a-4b5e-9fb9-5c4902063838 Jun 16 08:40:35 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:40:35 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Lock "cinder-quobyte-a2e6adf2-02b5-4a0f-997f-6cec76886b52" released by "delete_volume" :: held 8.279s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:40:35 devstack cinder-volume[92348]: WARNING cinder.quota [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:40:35 devstack cinder-volume[92348]: WARNING cinder.quota [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:40:35 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Created reservations ['8507ed9c-54cb-4163-88c7-dcd97bc15026', '26ed8d1c-fa17-44aa-bc5f-2abda385ffd1', '8908e3f5-a74a-4111-85ce-3a291d7b8f6f', '00d6c023-7f2c-4113-acd5-6e4db913b095'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:40:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:40:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:40:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:40:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:40:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:40:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:40:36 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:40:36 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:40:36 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Jun 16 08:40:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8779006b-b00a-4b5e-9fb9-5c4902063838" returned: 0 in 1.319s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:40:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] <== create_volume: return (3355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:40:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.364s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:40:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4c513c-9344-42a0-8a4a-4890bf726e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8779006b-b00a-4b5e-9fb9-5c4902063838', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:40:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8a10aa-b80e-4fa8-826a-0145a610820a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:40:36 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Volume volume-8779006b-b00a-4b5e-9fb9-5c4902063838 (8779006b-b00a-4b5e-9fb9-5c4902063838): created successfully Jun 16 08:40:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8a10aa-b80e-4fa8-826a-0145a610820a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:40:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Flow 'volume_create_manager' (58a89736-6815-48cd-9a2c-86d85ec8e6a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:40:37 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-1d848aa6-b75c-480e-8c57-67fec7253d3d tempest-ServerRescueNegativeTestJSON-527802132 None] Created volume successfully. Jun 16 08:40:37 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Jun 16 08:40:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.420s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:40:37 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:40:37 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Deleted volume successfully. Jun 16 08:40:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d1785e49-b3e2-4e6b-b82f-df1b38f1ff9c tempest-VolumesAdminNegativeTest-399392069 None] Lock "cinder-a2e6adf2-02b5-4a0f-997f-6cec76886b52-delete_volume" released by "delete_volume" :: held 10.330s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:40:47 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=7,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=1 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:40:47 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:UPDATE=14,cinder:SELECT=11,cinder:INSERT=5,cinder:DELETE=1 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:41:01 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=1 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:41:01 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:UPDATE=1 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:41:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] Acquiring lock "cinder-8779006b-b00a-4b5e-9fb9-5c4902063838-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:41:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] Lock "cinder-8779006b-b00a-4b5e-9fb9-5c4902063838-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:41:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] Acquiring lock "cinder-quobyte-8779006b-b00a-4b5e-9fb9-5c4902063838" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:41:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] Lock "cinder-quobyte-8779006b-b00a-4b5e-9fb9-5c4902063838" acquired by "delete_volume" :: waited 0.028s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:41:01 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb2a5f8-b1c4-45cc-8064-9a133a73149f]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:41:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8779006b-b00a-4b5e-9fb9-5c4902063838 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:01 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8779006b-b00a-4b5e-9fb9-5c4902063838 Jun 16 08:41:01 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:02 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8779006b-b00a-4b5e-9fb9-5c4902063838" returned: 0 in 0.952s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8779006b-b00a-4b5e-9fb9-5c4902063838 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:02 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8779006b-b00a-4b5e-9fb9-5c4902063838 Jun 16 08:41:02 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:03 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8779006b-b00a-4b5e-9fb9-5c4902063838" returned: 0 in 0.801s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] Lock "cinder-quobyte-8779006b-b00a-4b5e-9fb9-5c4902063838" released by "delete_volume" :: held 1.821s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:41:03 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] Created reservations ['25811233-a676-4e27-a4e2-6f935fecee5c', '7caa35eb-f776-4aec-a32c-463bd8255c14', '8ac04af2-97e9-4884-ac0f-b4654350a73b', '5890ff63-ff2f-44c2-a2ec-106e3e6c0d90'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:41:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:03 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:41:03 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:41:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:41:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:03 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:41:03 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:04 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.893s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:04 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:41:04 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] Deleted volume successfully. Jun 16 08:41:04 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4f0c3cdb-cd2d-491d-9aaf-454d867f83cd tempest-ServerRescueNegativeTestJSON-527802132 None] Lock "cinder-8779006b-b00a-4b5e-9fb9-5c4902063838-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:41:13 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=10 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:41:14 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:UPDATE=6,cinder:SELECT=2,cinder:INSERT=3,cinder:DELETE=1 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:41:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:41:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:41:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:41:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:41:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:30 devstack sudo[94107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:41:30 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:31 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.038s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:31 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:41:31 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:41:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 8 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:41:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:41:31 devstack cinder-volume[92348]: WARNING py.warnings [req-2d83c109-7699-459a-8999-97654d673670 req-017fb413-860d-4cb6-abe4-af26eab1e3cc tempest-TaggedAttachmentsTest-1811367975 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2505: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jun 16 08:41:31 devstack cinder-volume[92348]: .first() Jun 16 08:41:31 devstack cinder-volume[92348]: Jun 16 08:41:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-2d83c109-7699-459a-8999-97654d673670 req-017fb413-860d-4cb6-abe4-af26eab1e3cc tempest-TaggedAttachmentsTest-1811367975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-2d83c109-7699-459a-8999-97654d673670 req-017fb413-860d-4cb6-abe4-af26eab1e3cc tempest-TaggedAttachmentsTest-1811367975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:31 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f5f0b6-c022-49ab-ae04-5d7c5d5ac304]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:41:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-2d83c109-7699-459a-8999-97654d673670 req-017fb413-860d-4cb6-abe4-af26eab1e3cc tempest-TaggedAttachmentsTest-1811367975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:31 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c Jun 16 08:41:31 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:32 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-2d83c109-7699-459a-8999-97654d673670 req-017fb413-860d-4cb6-abe4-af26eab1e3cc tempest-TaggedAttachmentsTest-1811367975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c" returned: 0 in 0.842s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-2d83c109-7699-459a-8999-97654d673670 req-017fb413-860d-4cb6-abe4-af26eab1e3cc tempest-TaggedAttachmentsTest-1811367975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.866s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:41:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-2d83c109-7699-459a-8999-97654d673670 req-017fb413-860d-4cb6-abe4-af26eab1e3cc tempest-TaggedAttachmentsTest-1811367975 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5a50c83-6a18-410a-b9c4-b5a5855e4778', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:41:32 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-2d83c109-7699-459a-8999-97654d673670 req-017fb413-860d-4cb6-abe4-af26eab1e3cc tempest-TaggedAttachmentsTest-1811367975 None] attachment_update completed successfully. Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Flow 'volume_create_manager' (f3732bbe-4a94-4dfb-87c5-2e3c2c07b810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84799358-9fbe-4ae6-9efd-7c56632f7f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84799358-9fbe-4ae6-9efd-7c56632f7f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1758853947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957155de-34b1-4afd-9e59-28c0b19f6068,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d81b9c71b35e480ea8f31b96234aeb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:41:35Z,use_quota=True,user_id='bdf6777f7e9841099265664adb89507c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b486ed-92d5-4bac-93a9-2eacdc2b3887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b486ed-92d5-4bac-93a9-2eacdc2b3887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8938eeae-9f0e-49ef-a79b-d6801562ea50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8938eeae-9f0e-49ef-a79b-d6801562ea50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '957155de-34b1-4afd-9e59-28c0b19f6068', 'volume_name': 'volume-957155de-34b1-4afd-9e59-28c0b19f6068', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91539f6-588e-4ee6-a837-63f9616fb873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91539f6-588e-4ee6-a837-63f9616fb873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be219dd4-b3ec-41fc-9d67-a7bdfe5880dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:35 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Volume 957155de-34b1-4afd-9e59-28c0b19f6068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-957155de-34b1-4afd-9e59-28c0b19f6068', 'volume_size': 1} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1758853947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957155de-34b1-4afd-9e59-28c0b19f6068,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d81b9c71b35e480ea8f31b96234aeb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:41:35Z,use_quota=True,user_id='bdf6777f7e9841099265664adb89507c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Creating volume 957155de-34b1-4afd-9e59-28c0b19f6068 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:41:35 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:41:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-957155de-34b1-4afd-9e59-28c0b19f6068 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:35 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-957155de-34b1-4afd-9e59-28c0b19f6068 1073741824 Jun 16 08:41:35 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:36 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-957155de-34b1-4afd-9e59-28c0b19f6068 1073741824" returned: 0 in 1.077s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-957155de-34b1-4afd-9e59-28c0b19f6068 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:36 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-957155de-34b1-4afd-9e59-28c0b19f6068 Jun 16 08:41:36 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:37 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-957155de-34b1-4afd-9e59-28c0b19f6068" returned: 0 in 0.669s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:41:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:41:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be219dd4-b3ec-41fc-9d67-a7bdfe5880dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-957155de-34b1-4afd-9e59-28c0b19f6068', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ae38fa-1e7a-4b16-8017-8c3949cf7abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:37 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Volume volume-957155de-34b1-4afd-9e59-28c0b19f6068 (957155de-34b1-4afd-9e59-28c0b19f6068): created successfully Jun 16 08:41:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ae38fa-1e7a-4b16-8017-8c3949cf7abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Flow 'volume_create_manager' (f3732bbe-4a94-4dfb-87c5-2e3c2c07b810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:41:37 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-cda8f807-b8d6-4059-b433-4faf4a6bd004 req-cdf8797d-e4c2-4e2a-84df-d2041f0ea14a tempest-VolumesGetTestJSON-191244308 None] Created volume successfully. Jun 16 08:41:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] Acquiring lock "cinder-957155de-34b1-4afd-9e59-28c0b19f6068-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:41:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] Lock "cinder-957155de-34b1-4afd-9e59-28c0b19f6068-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:41:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] Acquiring lock "cinder-quobyte-957155de-34b1-4afd-9e59-28c0b19f6068" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:41:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] Lock "cinder-quobyte-957155de-34b1-4afd-9e59-28c0b19f6068" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:41:38 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fef6bc1-c308-4641-8310-04bb1d5cc61e]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:41:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-957155de-34b1-4afd-9e59-28c0b19f6068 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:38 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-957155de-34b1-4afd-9e59-28c0b19f6068 Jun 16 08:41:38 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:39 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-957155de-34b1-4afd-9e59-28c0b19f6068" returned: 0 in 1.060s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-957155de-34b1-4afd-9e59-28c0b19f6068 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:39 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-957155de-34b1-4afd-9e59-28c0b19f6068 Jun 16 08:41:39 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:40 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-5a467214-13e4-4b5a-99b6-66253c4fe0df req-9389ad61-7c44-44e6-a661-84f39ade6d9d tempest-TaggedAttachmentsTest-1811367975 None] Terminate volume connection completed successfully. Jun 16 08:41:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-5a467214-13e4-4b5a-99b6-66253c4fe0df req-9389ad61-7c44-44e6-a661-84f39ade6d9d tempest-TaggedAttachmentsTest-1811367975 None] Deleting attachment e5a50c83-6a18-410a-b9c4-b5a5855e4778. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:41:40 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-957155de-34b1-4afd-9e59-28c0b19f6068" returned: 0 in 1.176s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:40 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] Lock "cinder-quobyte-957155de-34b1-4afd-9e59-28c0b19f6068" released by "delete_volume" :: held 2.309s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:41:40 devstack cinder-volume[92348]: DEBUG cinder.quota [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] Created reservations ['70e2e6fc-2815-4a0e-a8db-ddcb4b4597c0', '9cab8a48-08dc-4240-965c-6b74a8d3505c', 'f8187889-c539-4c8d-b655-949aa876f553', '2a9f4c7f-6803-40b1-8ead-94dee8ad8791'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:41:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:41:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:41:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:41:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:40 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:41:40 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:41 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.629s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:41 devstack cinder-volume[92348]: DEBUG cinder.manager [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:41:41 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] Deleted volume successfully. Jun 16 08:41:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-b36ee5d0-cea7-4857-a91a-bd0a87e67abb req-56befe80-6618-49ba-8801-38b9c5d5a5b8 tempest-VolumesGetTestJSON-191244308 None] Lock "cinder-957155de-34b1-4afd-9e59-28c0b19f6068-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:41:43 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:41:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Flow 'volume_create_manager' (4b0a2ec5-cff8-43bf-85c7-fda1206bb45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:41:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732c1f37-0329-4c78-a75b-eb373bbbaa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732c1f37-0329-4c78-a75b-eb373bbbaa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-974341208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4f6725-ea8c-4d8f-bb9c-162e535e235e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad34cbb04374ba5adbedb525c541240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:41:44Z,use_quota=True,user_id='a9a67ba0ca9f4496a875325d1bff1ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f45f33-73c6-4b58-bc2c-e4d9278db5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f45f33-73c6-4b58-bc2c-e4d9278db5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11736db4-f012-4065-8988-e4532da48c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11736db4-f012-4065-8988-e4532da48c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d4f6725-ea8c-4d8f-bb9c-162e535e235e', 'volume_name': 'volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48ed71f-21dc-4411-8a7d-498989654290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48ed71f-21dc-4411-8a7d-498989654290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7a508d-84f6-4e41-b33c-e4e2b09dad42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:44 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Volume 9d4f6725-ea8c-4d8f-bb9c-162e535e235e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e', 'volume_size': 1} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-974341208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4f6725-ea8c-4d8f-bb9c-162e535e235e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ad34cbb04374ba5adbedb525c541240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:41:44Z,use_quota=True,user_id='a9a67ba0ca9f4496a875325d1bff1ec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Creating volume 9d4f6725-ea8c-4d8f-bb9c-162e535e235e {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:41:44 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:44 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e 1073741824 Jun 16 08:41:44 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Flow 'volume_create_manager' (1fa9a938-4c60-4182-a500-eb81a3cce48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693fba7f-2de6-437f-adef-fa85e97ef3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693fba7f-2de6-437f-adef-fa85e97ef3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1982541614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03269d42-c6d4-4bc6-8aee-fae2b1998829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1960c5e434ed4b158dbb3e6c775d2808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:41:45Z,use_quota=True,user_id='aad3d24b98744c4fa81860546a040101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644fd869-2f24-4c24-be48-709690ae8a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644fd869-2f24-4c24-be48-709690ae8a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d174339-5d06-4a77-a6f0-fdb8e9aa15a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d174339-5d06-4a77-a6f0-fdb8e9aa15a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03269d42-c6d4-4bc6-8aee-fae2b1998829', 'volume_name': 'volume-03269d42-c6d4-4bc6-8aee-fae2b1998829', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22ab1b1-c602-44b4-b216-36219ab1d3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22ab1b1-c602-44b4-b216-36219ab1d3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2a2718-5bf5-4d53-8f26-49b9f6c21810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:44 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Volume 03269d42-c6d4-4bc6-8aee-fae2b1998829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03269d42-c6d4-4bc6-8aee-fae2b1998829', 'volume_size': 1} Jun 16 08:41:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:45 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e 1073741824" returned: 0 in 1.256s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:45 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e Jun 16 08:41:45 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:46 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e" returned: 0 in 0.779s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] <== create_volume: return (2101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:41:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:41:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.373s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1982541614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03269d42-c6d4-4bc6-8aee-fae2b1998829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1960c5e434ed4b158dbb3e6c775d2808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:41:45Z,use_quota=True,user_id='aad3d24b98744c4fa81860546a040101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:41:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Creating volume 03269d42-c6d4-4bc6-8aee-fae2b1998829 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:41:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:41:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:41:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:41:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:41:46 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:41:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-03269d42-c6d4-4bc6-8aee-fae2b1998829 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7a508d-84f6-4e41-b33c-e4e2b09dad42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:46 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-03269d42-c6d4-4bc6-8aee-fae2b1998829 1073741824 Jun 16 08:41:46 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07210310-9e55-4c7d-a0a9-333780eb5260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:46 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Volume volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e (9d4f6725-ea8c-4d8f-bb9c-162e535e235e): created successfully Jun 16 08:41:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07210310-9e55-4c7d-a0a9-333780eb5260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Flow 'volume_create_manager' (4b0a2ec5-cff8-43bf-85c7-fda1206bb45f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:41:46 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-0b4e3a21-d218-4237-8449-52aa431afd4f tempest-DeleteServersTestJSON-1685435069 None] Created volume successfully. Jun 16 08:41:47 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-03269d42-c6d4-4bc6-8aee-fae2b1998829 1073741824" returned: 0 in 0.919s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-03269d42-c6d4-4bc6-8aee-fae2b1998829 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:47 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-03269d42-c6d4-4bc6-8aee-fae2b1998829 Jun 16 08:41:47 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:48 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-03269d42-c6d4-4bc6-8aee-fae2b1998829" returned: 0 in 0.913s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:41:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:41:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2a2718-5bf5-4d53-8f26-49b9f6c21810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03269d42-c6d4-4bc6-8aee-fae2b1998829', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143c11e5-1c04-4c29-a469-5d2fa2ac7f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:48 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Volume volume-03269d42-c6d4-4bc6-8aee-fae2b1998829 (03269d42-c6d4-4bc6-8aee-fae2b1998829): created successfully Jun 16 08:41:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143c11e5-1c04-4c29-a469-5d2fa2ac7f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Flow 'volume_create_manager' (1fa9a938-4c60-4182-a500-eb81a3cce48d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:41:48 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-df0c5b1c-f8cb-434b-9b1e-517e0c2433d9 tempest-ServersNegativeTestJSON-1491931624 None] Created volume successfully. Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Flow 'volume_create_manager' (0e72479d-7655-4e3c-add3-9567c32a5b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb062724-d8d9-4dca-a7ab-05c4822d11cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb062724-d8d9-4dca-a7ab-05c4822d11cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1731131025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c75d29-37bd-4e38-bd5d-88718fc58d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1960c5e434ed4b158dbb3e6c775d2808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:41:51Z,use_quota=True,user_id='aad3d24b98744c4fa81860546a040101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd2a2ea-8ccb-4513-b364-9e076e3641ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd2a2ea-8ccb-4513-b364-9e076e3641ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847ddb67-b228-4c05-8779-b372aec46d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847ddb67-b228-4c05-8779-b372aec46d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29c75d29-37bd-4e38-bd5d-88718fc58d06', 'volume_name': 'volume-29c75d29-37bd-4e38-bd5d-88718fc58d06', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0701513a-4123-4417-ad1f-772041701eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0701513a-4123-4417-ad1f-772041701eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8878fea5-589c-4fad-b108-9941bda2bc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:50 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Volume 29c75d29-37bd-4e38-bd5d-88718fc58d06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29c75d29-37bd-4e38-bd5d-88718fc58d06', 'volume_size': 1} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1731131025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c75d29-37bd-4e38-bd5d-88718fc58d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1960c5e434ed4b158dbb3e6c775d2808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:41:51Z,use_quota=True,user_id='aad3d24b98744c4fa81860546a040101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Creating volume 29c75d29-37bd-4e38-bd5d-88718fc58d06 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:41:50 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29c75d29-37bd-4e38-bd5d-88718fc58d06 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:50 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29c75d29-37bd-4e38-bd5d-88718fc58d06 1073741824 Jun 16 08:41:50 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-2fca359d-0ea5-450a-b9e0-0316f8159621 req-7dc2fe1e-96dc-4e3c-aae3-c2e9b6e55349 tempest-DeleteServersTestJSON-1685435069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:52 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29c75d29-37bd-4e38-bd5d-88718fc58d06 1073741824" returned: 0 in 1.468s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29c75d29-37bd-4e38-bd5d-88718fc58d06 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:52 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29c75d29-37bd-4e38-bd5d-88718fc58d06 Jun 16 08:41:52 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:53 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29c75d29-37bd-4e38-bd5d-88718fc58d06" returned: 0 in 0.943s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] <== create_volume: return (2482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:41:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.486s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:41:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-2fca359d-0ea5-450a-b9e0-0316f8159621 req-7dc2fe1e-96dc-4e3c-aae3-c2e9b6e55349 tempest-DeleteServersTestJSON-1685435069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.383s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:53 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[014b348a-3d12-4b98-911e-09c9134da528]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:41:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-2fca359d-0ea5-450a-b9e0-0316f8159621 req-7dc2fe1e-96dc-4e3c-aae3-c2e9b6e55349 tempest-DeleteServersTestJSON-1685435069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8878fea5-589c-4fad-b108-9941bda2bc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29c75d29-37bd-4e38-bd5d-88718fc58d06', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b6f96f-dc2d-478b-b99b-7c7137acc91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:53 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Volume volume-29c75d29-37bd-4e38-bd5d-88718fc58d06 (29c75d29-37bd-4e38-bd5d-88718fc58d06): created successfully Jun 16 08:41:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b6f96f-dc2d-478b-b99b-7c7137acc91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Flow 'volume_create_manager' (0e72479d-7655-4e3c-add3-9567c32a5b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:41:53 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ee9d0de8-0bb2-461f-9cd8-ebf4e248a598 tempest-ServersNegativeTestJSON-1491931624 None] Created volume successfully. Jun 16 08:41:53 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e Jun 16 08:41:53 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:54 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-2fca359d-0ea5-450a-b9e0-0316f8159621 req-7dc2fe1e-96dc-4e3c-aae3-c2e9b6e55349 tempest-DeleteServersTestJSON-1685435069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e" returned: 0 in 0.843s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-2fca359d-0ea5-450a-b9e0-0316f8159621 req-7dc2fe1e-96dc-4e3c-aae3-c2e9b6e55349 tempest-DeleteServersTestJSON-1685435069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.889s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:41:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-2fca359d-0ea5-450a-b9e0-0316f8159621 req-7dc2fe1e-96dc-4e3c-aae3-c2e9b6e55349 tempest-DeleteServersTestJSON-1685435069 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ea00570-8972-479d-91d0-7541303d10a9', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:41:54 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-2fca359d-0ea5-450a-b9e0-0316f8159621 req-7dc2fe1e-96dc-4e3c-aae3-c2e9b6e55349 tempest-DeleteServersTestJSON-1685435069 None] attachment_update completed successfully. Jun 16 08:41:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] Acquiring lock "cinder-29c75d29-37bd-4e38-bd5d-88718fc58d06-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:41:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] Lock "cinder-29c75d29-37bd-4e38-bd5d-88718fc58d06-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:41:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] Acquiring lock "cinder-quobyte-29c75d29-37bd-4e38-bd5d-88718fc58d06" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:41:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] Lock "cinder-quobyte-29c75d29-37bd-4e38-bd5d-88718fc58d06" acquired by "delete_volume" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:41:54 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[37815536-0165-4fc8-851a-687077925f0b]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:41:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29c75d29-37bd-4e38-bd5d-88718fc58d06 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:55 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29c75d29-37bd-4e38-bd5d-88718fc58d06 Jun 16 08:41:55 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Flow 'volume_create_manager' (81bdd6af-136b-4335-86b0-f27280df8406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2076a2ac-c6d7-4d34-b899-19de6725d595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2076a2ac-c6d7-4d34-b899-19de6725d595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-848058278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc7866d-5255-4e7e-ac57-8915e88ab973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b7048f30b342b78debcd006c8e2923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:41:55Z,use_quota=True,user_id='dec2af81e3b84299880c79855f807f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817948c5-750d-4958-b409-2e3954ab22eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817948c5-750d-4958-b409-2e3954ab22eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e380792f-9d17-46e5-b432-f70244f4bd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e380792f-9d17-46e5-b432-f70244f4bd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cc7866d-5255-4e7e-ac57-8915e88ab973', 'volume_name': 'volume-0cc7866d-5255-4e7e-ac57-8915e88ab973', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6256c14-6f52-494c-9541-91484944086b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6256c14-6f52-494c-9541-91484944086b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d82192-2496-47fb-a6a5-e26afd0ae33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:55 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Volume 0cc7866d-5255-4e7e-ac57-8915e88ab973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cc7866d-5255-4e7e-ac57-8915e88ab973', 'volume_size': 1} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-848058278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc7866d-5255-4e7e-ac57-8915e88ab973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b7048f30b342b78debcd006c8e2923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:41:55Z,use_quota=True,user_id='dec2af81e3b84299880c79855f807f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Creating volume 0cc7866d-5255-4e7e-ac57-8915e88ab973 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:41:55 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:55 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973 1073741824 Jun 16 08:41:55 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:55 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29c75d29-37bd-4e38-bd5d-88718fc58d06" returned: 0 in 0.807s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29c75d29-37bd-4e38-bd5d-88718fc58d06 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:55 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29c75d29-37bd-4e38-bd5d-88718fc58d06 Jun 16 08:41:55 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:56 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973 1073741824" returned: 0 in 0.813s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:56 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973 Jun 16 08:41:56 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:56 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29c75d29-37bd-4e38-bd5d-88718fc58d06" returned: 0 in 0.629s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] Lock "cinder-quobyte-29c75d29-37bd-4e38-bd5d-88718fc58d06" released by "delete_volume" :: held 1.495s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:41:56 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] Created reservations ['31eefc85-0cb9-44bb-85dd-633421a5fc32', '96e21bfa-54d8-43fe-a5c0-f3a757a3f136', '631990c8-67f5-4552-9d05-d2db7b44d78c', '64431a88-3246-4f73-90b4-109d86af8c03'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:41:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:41:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:41:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:41:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:56 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:41:56 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:56 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973" returned: 0 in 0.628s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:41:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:41:56 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d82192-2496-47fb-a6a5-e26afd0ae33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cc7866d-5255-4e7e-ac57-8915e88ab973', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b26d6a-5f5f-4e11-a833-4d4c375dc3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:41:57 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Volume volume-0cc7866d-5255-4e7e-ac57-8915e88ab973 (0cc7866d-5255-4e7e-ac57-8915e88ab973): created successfully Jun 16 08:41:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b26d6a-5f5f-4e11-a833-4d4c375dc3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:41:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Flow 'volume_create_manager' (81bdd6af-136b-4335-86b0-f27280df8406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:41:57 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-a89fc7a9-578a-4084-8dda-f259fa6934f3 tempest-SnapshotsActionsTest-1448315170 None] Created volume successfully. Jun 16 08:41:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] Acquiring lock "cinder-03269d42-c6d4-4bc6-8aee-fae2b1998829-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:41:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] Lock "cinder-03269d42-c6d4-4bc6-8aee-fae2b1998829-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:41:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] Acquiring lock "cinder-quobyte-03269d42-c6d4-4bc6-8aee-fae2b1998829" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:41:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] Lock "cinder-quobyte-03269d42-c6d4-4bc6-8aee-fae2b1998829" acquired by "delete_volume" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:41:57 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.652s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:57 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:41:57 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] Deleted volume successfully. Jun 16 08:41:57 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc150ddc-84a9-4839-84f1-ddb7ee846f10]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:41:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-03269d42-c6d4-4bc6-8aee-fae2b1998829 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e0197e65-6949-4e5d-9220-077698be9767 tempest-ServersNegativeTestJSON-1491931624 None] Lock "cinder-29c75d29-37bd-4e38-bd5d-88718fc58d06-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:41:57 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-03269d42-c6d4-4bc6-8aee-fae2b1998829 Jun 16 08:41:57 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:58 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-03269d42-c6d4-4bc6-8aee-fae2b1998829" returned: 0 in 0.805s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-03269d42-c6d4-4bc6-8aee-fae2b1998829 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:58 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-03269d42-c6d4-4bc6-8aee-fae2b1998829 Jun 16 08:41:58 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] Creating offline snapshot 2827bdd3-e8a8-4b72-bb76-e9c21baed775 of volume 0cc7866d-5255-4e7e-ac57-8915e88ab973 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:41:58 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2345c03-09b5-412c-8ac6-a7f28b02859c]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:41:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:58 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973 Jun 16 08:41:58 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:58 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-03269d42-c6d4-4bc6-8aee-fae2b1998829" returned: 0 in 0.717s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] Lock "cinder-quobyte-03269d42-c6d4-4bc6-8aee-fae2b1998829" released by "delete_volume" :: held 1.578s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:41:58 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] Created reservations ['390e3ae8-2598-4e43-a4d6-9361f207a92d', 'c8706ead-f08f-4e30-8126-8f9543f69408', 'dca1f643-acba-4232-b2f4-4aba425e930b', '67777881-e084-4e6a-a404-2db8b255960e'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:41:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:41:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:41:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:41:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:41:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:41:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:58 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:41:58 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:41:59 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Jun 16 08:41:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973" returned: 0 in 0.950s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:41:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:41:59 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 1G Jun 16 08:41:59 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:00 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.128s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:00 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:42:00 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] Deleted volume successfully. Jun 16 08:42:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5fc97443-1506-414c-9830-98c9ae461a6e tempest-ServersNegativeTestJSON-1491931624 None] Lock "cinder-03269d42-c6d4-4bc6-8aee-fae2b1998829-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:00 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 1G" returned: 0 in 1.561s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc7866d-5255-4e7e-ac57-8915e88ab973 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:00 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc7866d-5255-4e7e-ac57-8915e88ab973 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 Jun 16 08:42:00 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:01 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc7866d-5255-4e7e-ac57-8915e88ab973 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775" returned: 0 in 0.897s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:01 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 is being set with open permissions: ugo+rw Jun 16 08:42:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:01 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 Jun 16 08:42:01 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] Acquiring lock "cinder-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] Lock "cinder-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] Acquiring lock "cinder-quobyte-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] Lock "cinder-quobyte-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c" acquired by "delete_volume" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:02 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[566c8ca8-3275-4b2f-974f-d7964db77257]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:02 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775" returned: 0 in 0.757s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:02 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.info Jun 16 08:42:02 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:02 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c Jun 16 08:42:02 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:03 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c" returned: 0 in 0.943s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:03 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c Jun 16 08:42:03 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:03 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.info" returned: 0 in 0.950s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:03 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.info is being set with open permissions: ugo+rw Jun 16 08:42:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:03 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.info Jun 16 08:42:03 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:03 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-fe3a80c2-8de0-4e16-80ea-0c2876467850 req-ae658559-9fa8-4704-9bc0-0c391315bfe0 tempest-DeleteServersTestJSON-1685435069 None] Terminate volume connection completed successfully. Jun 16 08:42:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-fe3a80c2-8de0-4e16-80ea-0c2876467850 req-ae658559-9fa8-4704-9bc0-0c391315bfe0 tempest-DeleteServersTestJSON-1685435069 None] Deleting attachment 1ea00570-8972-479d-91d0-7541303d10a9. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:42:03 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c" returned: 0 in 0.664s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] Lock "cinder-quobyte-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c" released by "delete_volume" :: held 1.660s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:03 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] Created reservations ['e27d5c21-8737-49c9-8377-235725e021e6', '9134838d-d649-4b26-b7f5-b809f5a76b17', 'a9b6ee51-8215-413c-a751-806c130c0a36', '6155c1dd-20b3-486a-b4cf-4b1f1535c7f9'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:42:03 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.info" returned: 0 in 0.676s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.898s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:42:04 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-919bb14b-e675-430f-8c64-596cee6bb838 tempest-SnapshotsActionsTest-1448315170 None] Create snapshot completed successfully Jun 16 08:42:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:42:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:42:04 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:42:04 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:42:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:42:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:04 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:42:04 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:04 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.605s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:04 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:42:04 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] Deleted volume successfully. Jun 16 08:42:04 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e95a7d4a-7d07-431f-b7e8-fa13c4d2e694 tempest-TaggedAttachmentsTest-1811367975 None] Lock "cinder-71500bbb-c82a-4e08-b7d2-0ae2b2f6387c-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8c3dc034-f97b-4e53-9b0d-aeb547dc6753 tempest-SnapshotsActionsTest-1448315170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:42:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8c3dc034-f97b-4e53-9b0d-aeb547dc6753 tempest-SnapshotsActionsTest-1448315170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:42:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-8c3dc034-f97b-4e53-9b0d-aeb547dc6753 tempest-SnapshotsActionsTest-1448315170 None] Creating offline snapshot a10ac172-c5df-41ca-b5f6-48f3b9848cee of volume 0cc7866d-5255-4e7e-ac57-8915e88ab973 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:42:05 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c67f0c-2edb-4b7f-b138-8ef71ef66c02]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8c3dc034-f97b-4e53-9b0d-aeb547dc6753 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:05 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 Jun 16 08:42:05 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:05 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8c3dc034-f97b-4e53-9b0d-aeb547dc6753 tempest-SnapshotsActionsTest-1448315170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775" returned: 0 in 0.737s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-8c3dc034-f97b-4e53-9b0d-aeb547dc6753 tempest-SnapshotsActionsTest-1448315170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc7866d-5255-4e7e-ac57-8915e88ab973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:42:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8c3dc034-f97b-4e53-9b0d-aeb547dc6753 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:05 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee 1G Jun 16 08:42:05 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:06 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8c3dc034-f97b-4e53-9b0d-aeb547dc6753 tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee 1G" returned: 0 in 0.852s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8c3dc034-f97b-4e53-9b0d-aeb547dc6753 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:06 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee Jun 16 08:42:06 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:07 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8c3dc034-f97b-4e53-9b0d-aeb547dc6753 tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee" returned: 0 in 0.719s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:07 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-8c3dc034-f97b-4e53-9b0d-aeb547dc6753 tempest-SnapshotsActionsTest-1448315170 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee is being set with open permissions: ugo+rw Jun 16 08:42:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8c3dc034-f97b-4e53-9b0d-aeb547dc6753 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:07 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee Jun 16 08:42:07 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] Acquiring lock "cinder-9d4f6725-ea8c-4d8f-bb9c-162e535e235e-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] Lock "cinder-9d4f6725-ea8c-4d8f-bb9c-162e535e235e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] Acquiring lock "cinder-quobyte-9d4f6725-ea8c-4d8f-bb9c-162e535e235e" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] Lock "cinder-quobyte-9d4f6725-ea8c-4d8f-bb9c-162e535e235e" acquired by "delete_volume" :: waited 0.028s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:07 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4236aa-b419-4694-8763-8526be1fe415]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:08 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e Jun 16 08:42:08 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:08 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8c3dc034-f97b-4e53-9b0d-aeb547dc6753 tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee" returned: 0 in 0.915s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8c3dc034-f97b-4e53-9b0d-aeb547dc6753 tempest-SnapshotsActionsTest-1448315170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.376s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:42:08 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-8c3dc034-f97b-4e53-9b0d-aeb547dc6753 tempest-SnapshotsActionsTest-1448315170 None] Create snapshot completed successfully Jun 16 08:42:08 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e" returned: 0 in 0.848s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:08 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e Jun 16 08:42:08 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Acquiring lock "cinder-a10ac172-c5df-41ca-b5f6-48f3b9848cee-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-a10ac172-c5df-41ca-b5f6-48f3b9848cee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Acquiring lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Acquiring lock "cinder-quobyte-a10ac172-c5df-41ca-b5f6-48f3b9848cee" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-quobyte-a10ac172-c5df-41ca-b5f6-48f3b9848cee" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Deleting offline snapshot a10ac172-c5df-41ca-b5f6-48f3b9848cee of volume 0cc7866d-5255-4e7e-ac57-8915e88ab973 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] snapshot_file for this snap is: volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03459a0-d944-4521-9d71-8c62201e800c]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:09 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9d4f6725-ea8c-4d8f-bb9c-162e535e235e" returned: 0 in 0.965s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] Lock "cinder-quobyte-9d4f6725-ea8c-4d8f-bb9c-162e535e235e" released by "delete_volume" :: held 1.878s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:09 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee Jun 16 08:42:09 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] Created reservations ['3555b9dd-dfd0-48d8-b862-cf9b43e771a1', '6644eeca-8202-470b-88e1-fb9c5fb0eb7e', '4e21fa5b-bd2d-404e-ad09-8f4e98c6fd3a', '566ae692-7948-4a1d-9053-7f4d1335d2a8'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:42:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:10 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:42:10 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:10 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee" returned: 0 in 1.025s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:10 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc7866d-5255-4e7e-ac57-8915e88ab973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:42:10 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b463e947-7f14-4d2b-95a3-d608327e063e]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:10 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 Jun 16 08:42:10 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:10 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.787s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:10 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:42:10 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] Deleted volume successfully. Jun 16 08:42:10 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f4b82552-a0d0-4b82-92e3-2492bff3c1ee tempest-DeleteServersTestJSON-1685435069 None] Lock "cinder-9d4f6725-ea8c-4d8f-bb9c-162e535e235e-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:11 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775" returned: 0 in 0.809s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:11 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc7866d-5255-4e7e-ac57-8915e88ab973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:42:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:11 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee Jun 16 08:42:11 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:12 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee" returned: 0 in 0.924s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:12 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee Jun 16 08:42:12 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:13 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.a10ac172-c5df-41ca-b5f6-48f3b9848cee" returned: 0 in 0.634s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-quobyte-a10ac172-c5df-41ca-b5f6-48f3b9848cee" released by "_delete_snapshot" :: held 3.519s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" released by "delete_snapshot" :: held 3.553s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:13 devstack cinder-volume[92348]: WARNING cinder.quota [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:42:13 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Created reservations ['7cb86da2-2016-4c78-951a-a3c0383c3fe5', '19b3ac10-dba5-487c-a5d8-c8cbb1db3959', '9ec488a5-39b3-462d-ae78-0c51b803ac11', '290a500d-cd6c-4793-93eb-fbb15cfff002'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:42:13 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Delete snapshot completed successfully. Jun 16 08:42:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-61cd9fee-e331-43d7-86d9-2cb21d8a6d64 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-a10ac172-c5df-41ca-b5f6-48f3b9848cee-delete_snapshot" released by "delete_snapshot" :: held 3.764s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0fdd3977-eec4-4c3f-a8db-5bdeea5e2aca tempest-SnapshotsActionsTest-1448315170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:42:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0fdd3977-eec4-4c3f-a8db-5bdeea5e2aca tempest-SnapshotsActionsTest-1448315170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:42:14 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-0fdd3977-eec4-4c3f-a8db-5bdeea5e2aca tempest-SnapshotsActionsTest-1448315170 None] Creating offline snapshot df19d19f-788e-4a9b-9455-54a1613e1db0 of volume 0cc7866d-5255-4e7e-ac57-8915e88ab973 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:42:14 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[172becc0-aee5-40de-a431-5e692217acc5]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0fdd3977-eec4-4c3f-a8db-5bdeea5e2aca tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:14 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 Jun 16 08:42:14 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:15 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0fdd3977-eec4-4c3f-a8db-5bdeea5e2aca tempest-SnapshotsActionsTest-1448315170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775" returned: 0 in 0.998s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:15 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-0fdd3977-eec4-4c3f-a8db-5bdeea5e2aca tempest-SnapshotsActionsTest-1448315170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc7866d-5255-4e7e-ac57-8915e88ab973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:42:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0fdd3977-eec4-4c3f-a8db-5bdeea5e2aca tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:15 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0 1G Jun 16 08:42:15 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:16 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0fdd3977-eec4-4c3f-a8db-5bdeea5e2aca tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0 1G" returned: 0 in 0.950s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0fdd3977-eec4-4c3f-a8db-5bdeea5e2aca tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:16 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0 Jun 16 08:42:16 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:16 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0fdd3977-eec4-4c3f-a8db-5bdeea5e2aca tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0" returned: 0 in 0.836s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:16 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-0fdd3977-eec4-4c3f-a8db-5bdeea5e2aca tempest-SnapshotsActionsTest-1448315170 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0 is being set with open permissions: ugo+rw Jun 16 08:42:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0fdd3977-eec4-4c3f-a8db-5bdeea5e2aca tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:16 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0 Jun 16 08:42:16 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:17 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0fdd3977-eec4-4c3f-a8db-5bdeea5e2aca tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0" returned: 0 in 0.618s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0fdd3977-eec4-4c3f-a8db-5bdeea5e2aca tempest-SnapshotsActionsTest-1448315170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.523s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:42:17 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-0fdd3977-eec4-4c3f-a8db-5bdeea5e2aca tempest-SnapshotsActionsTest-1448315170 None] Create snapshot completed successfully Jun 16 08:42:18 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Acquiring lock "cinder-df19d19f-788e-4a9b-9455-54a1613e1db0-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:18 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-df19d19f-788e-4a9b-9455-54a1613e1db0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:18 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Acquiring lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:18 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" acquired by "delete_snapshot" :: waited 0.037s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:18 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Acquiring lock "cinder-quobyte-df19d19f-788e-4a9b-9455-54a1613e1db0" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:18 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-quobyte-df19d19f-788e-4a9b-9455-54a1613e1db0" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:18 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Deleting offline snapshot df19d19f-788e-4a9b-9455-54a1613e1db0 of volume 0cc7866d-5255-4e7e-ac57-8915e88ab973 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:42:18 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] snapshot_file for this snap is: volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:42:18 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89121c1-4f45-4cad-b088-d5f0476f1343]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:18 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0 Jun 16 08:42:18 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:19 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0" returned: 0 in 0.946s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc7866d-5255-4e7e-ac57-8915e88ab973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:42:19 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e538e7-4d08-4006-b529-1f9d4ccd6152]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:19 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 Jun 16 08:42:19 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:20 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775" returned: 0 in 0.780s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:20 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc7866d-5255-4e7e-ac57-8915e88ab973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:42:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:20 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0 Jun 16 08:42:20 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:21 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0" returned: 0 in 0.831s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:21 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0 Jun 16 08:42:21 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:21 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.df19d19f-788e-4a9b-9455-54a1613e1db0" returned: 0 in 0.657s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:21 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-quobyte-df19d19f-788e-4a9b-9455-54a1613e1db0" released by "_delete_snapshot" :: held 3.368s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:21 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" released by "delete_snapshot" :: held 3.419s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:21 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Created reservations ['5e318a97-4910-4225-b6dd-dfd6fd494da9', '096965e8-7fb8-4a6e-9e0d-0104738334e6', 'f494e848-a6db-49e7-a11b-ea58f0e3c03b', '6df09a75-3731-48d6-94db-95b40bdfef49'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:42:22 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Delete snapshot completed successfully. Jun 16 08:42:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-605bd0f3-6eaa-4cae-8f41-a6fe944d037b tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-df19d19f-788e-4a9b-9455-54a1613e1db0-delete_snapshot" released by "delete_snapshot" :: held 3.598s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-841e8c14-8fea-41eb-a8fd-2909f0fbcc50 tempest-SnapshotsActionsTest-1448315170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:42:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-841e8c14-8fea-41eb-a8fd-2909f0fbcc50 tempest-SnapshotsActionsTest-1448315170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:42:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-841e8c14-8fea-41eb-a8fd-2909f0fbcc50 tempest-SnapshotsActionsTest-1448315170 None] Creating offline snapshot bee1a314-f2e1-46f5-bd3c-6a2c633da85b of volume 0cc7866d-5255-4e7e-ac57-8915e88ab973 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:42:23 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79d70db-9180-47c9-a2bf-0e0326fb8aca]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-841e8c14-8fea-41eb-a8fd-2909f0fbcc50 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:23 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 Jun 16 08:42:23 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:23 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-841e8c14-8fea-41eb-a8fd-2909f0fbcc50 tempest-SnapshotsActionsTest-1448315170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775" returned: 0 in 0.767s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-841e8c14-8fea-41eb-a8fd-2909f0fbcc50 tempest-SnapshotsActionsTest-1448315170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc7866d-5255-4e7e-ac57-8915e88ab973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:42:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-841e8c14-8fea-41eb-a8fd-2909f0fbcc50 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:23 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b 1G Jun 16 08:42:23 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:24 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-841e8c14-8fea-41eb-a8fd-2909f0fbcc50 tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b 1G" returned: 0 in 1.014s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-841e8c14-8fea-41eb-a8fd-2909f0fbcc50 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:24 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b Jun 16 08:42:24 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:25 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-841e8c14-8fea-41eb-a8fd-2909f0fbcc50 tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b" returned: 0 in 0.768s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:25 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-841e8c14-8fea-41eb-a8fd-2909f0fbcc50 tempest-SnapshotsActionsTest-1448315170 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b is being set with open permissions: ugo+rw Jun 16 08:42:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-841e8c14-8fea-41eb-a8fd-2909f0fbcc50 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:25 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b Jun 16 08:42:25 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:26 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-841e8c14-8fea-41eb-a8fd-2909f0fbcc50 tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b" returned: 0 in 0.726s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:26 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=81,cinder:UPDATE=67,cinder:INSERT=12,cinder:DELETE=3 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:42:26 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=54,cinder:UPDATE=79,cinder:INSERT=22,cinder:DELETE=10 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:42:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-841e8c14-8fea-41eb-a8fd-2909f0fbcc50 tempest-SnapshotsActionsTest-1448315170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.406s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:42:26 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-841e8c14-8fea-41eb-a8fd-2909f0fbcc50 tempest-SnapshotsActionsTest-1448315170 None] Create snapshot completed successfully Jun 16 08:42:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Acquiring lock "cinder-bee1a314-f2e1-46f5-bd3c-6a2c633da85b-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-bee1a314-f2e1-46f5-bd3c-6a2c633da85b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Acquiring lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" acquired by "delete_snapshot" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Acquiring lock "cinder-quobyte-bee1a314-f2e1-46f5-bd3c-6a2c633da85b" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-quobyte-bee1a314-f2e1-46f5-bd3c-6a2c633da85b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Deleting offline snapshot bee1a314-f2e1-46f5-bd3c-6a2c633da85b of volume 0cc7866d-5255-4e7e-ac57-8915e88ab973 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:42:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] snapshot_file for this snap is: volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:42:27 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda03a3b-447d-43be-a723-1182548bf151]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:27 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b Jun 16 08:42:27 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ba7fa201-0084-4466-a29e-e19f36602734 tempest-GroupsV314Test-585070636 None] Group tempest-GroupsV314Test-Group-2010705940: creating Jun 16 08:42:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ba7fa201-0084-4466-a29e-e19f36602734 tempest-GroupsV314Test-585070636 None] Group tempest-GroupsV314Test-Group-2010705940: created successfully Jun 16 08:42:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ba7fa201-0084-4466-a29e-e19f36602734 tempest-GroupsV314Test-585070636 None] Create group completed successfully. Jun 16 08:42:28 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b" returned: 0 in 0.809s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc7866d-5255-4e7e-ac57-8915e88ab973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:42:28 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d850d9-0586-4cb1-a23f-65f9d56c958b]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:28 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 Jun 16 08:42:28 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:29 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775" returned: 0 in 0.815s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:29 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc7866d-5255-4e7e-ac57-8915e88ab973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:42:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:29 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b Jun 16 08:42:29 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:42:30 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:42:30 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:30 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Flow 'volume_create_manager' (c883f9f2-d436-4b96-a990-8bcbd5c4a641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ca08b8-3f2d-4ea2-a5f6-b25f2421d6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b" returned: 0 in 1.063s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:30 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b Jun 16 08:42:30 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ca08b8-3f2d-4ea2-a5f6-b25f2421d6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-717323887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea9c1e58-b744-4309-95d7-86bfcab9f0a3,host='devstack@QuobyteHD#QuobyteHD',id=8887acc6-d539-45e7-8a02-34fed3b8d7ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487c1d6430f44dd482dc38606b0bda33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:42:30Z,use_quota=True,user_id='dcbaa7fe6e3340c5ad4c027abdaa8553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b65605f9-2226-47c9-b226-8b508fe264c4),volume_type_id=b65605f9-2226-47c9-b226-8b508fe264c4)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e33a5d-bcd1-446d-83ce-b160fae5e31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e33a5d-bcd1-446d-83ce-b160fae5e31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717508bc-d6eb-4781-841a-f997a128ab2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717508bc-d6eb-4781-841a-f997a128ab2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8887acc6-d539-45e7-8a02-34fed3b8d7ed', 'volume_name': 'volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a179c8f-4525-47c8-b57c-d7345db8942b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a179c8f-4525-47c8-b57c-d7345db8942b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3966be99-7e2d-4952-9155-3df6a2ff46e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:42:30 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Volume 8887acc6-d539-45e7-8a02-34fed3b8d7ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed', 'volume_size': 1} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ea9c1e58-b744-4309-95d7-86bfcab9f0a3,created_at=2026-06-16T06:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-717323887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea9c1e58-b744-4309-95d7-86bfcab9f0a3,host='devstack@QuobyteHD#QuobyteHD',id=8887acc6-d539-45e7-8a02-34fed3b8d7ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487c1d6430f44dd482dc38606b0bda33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:42:30Z,use_quota=True,user_id='dcbaa7fe6e3340c5ad4c027abdaa8553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b65605f9-2226-47c9-b226-8b508fe264c4),volume_type_id=b65605f9-2226-47c9-b226-8b508fe264c4)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Creating volume 8887acc6-d539-45e7-8a02-34fed3b8d7ed {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:42:30 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:30 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed 1073741824 Jun 16 08:42:30 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:30 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.781s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:30 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:42:31 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.bee1a314-f2e1-46f5-bd3c-6a2c633da85b" returned: 0 in 0.859s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:31 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-quobyte-bee1a314-f2e1-46f5-bd3c-6a2c633da85b" released by "_delete_snapshot" :: held 3.673s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:31 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" released by "delete_snapshot" :: held 3.704s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:31 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Created reservations ['f187eb0d-12b0-46e3-9078-31bfccd7591b', 'f7859c07-888e-45fe-9585-c0b628f045a1', 'c77b35ae-2a7a-4fae-853a-bff1cb61ffdb', 'aea70617-22d1-439a-b8e9-c1f8359ed388'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:42:31 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Delete snapshot completed successfully. Jun 16 08:42:31 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6a019d9c-c2f6-495e-a797-9f982ead7ee6 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-bee1a314-f2e1-46f5-bd3c-6a2c633da85b-delete_snapshot" released by "delete_snapshot" :: held 3.951s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:31 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed 1073741824" returned: 0 in 1.204s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:31 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed Jun 16 08:42:31 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ff0e1ca6-9e22-4d2a-82d1-c1cc6135b75e tempest-SnapshotsActionsTest-1448315170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:42:32 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed" returned: 0 in 0.716s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:42:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:42:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ff0e1ca6-9e22-4d2a-82d1-c1cc6135b75e tempest-SnapshotsActionsTest-1448315170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.066s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:42:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3966be99-7e2d-4952-9155-3df6a2ff46e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:42:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b4ee47-720d-4cc7-829e-fa447a7b3da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:42:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-ff0e1ca6-9e22-4d2a-82d1-c1cc6135b75e tempest-SnapshotsActionsTest-1448315170 None] Creating offline snapshot 8081cae3-8171-4d1b-afe8-21cbd8528eeb of volume 0cc7866d-5255-4e7e-ac57-8915e88ab973 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:42:32 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Volume volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed (8887acc6-d539-45e7-8a02-34fed3b8d7ed): created successfully Jun 16 08:42:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b4ee47-720d-4cc7-829e-fa447a7b3da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:42:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Flow 'volume_create_manager' (c883f9f2-d436-4b96-a990-8bcbd5c4a641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:42:32 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23b80a4-f2e1-49f7-bdcd-e5894f44be5c]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ff0e1ca6-9e22-4d2a-82d1-c1cc6135b75e tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:32 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-9f2229c0-5562-4b19-8c40-c55d0f4d6e03 tempest-GroupsV314Test-585070636 None] Created volume successfully. Jun 16 08:42:32 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 Jun 16 08:42:32 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:33 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ff0e1ca6-9e22-4d2a-82d1-c1cc6135b75e tempest-SnapshotsActionsTest-1448315170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775" returned: 0 in 0.759s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-ff0e1ca6-9e22-4d2a-82d1-c1cc6135b75e tempest-SnapshotsActionsTest-1448315170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc7866d-5255-4e7e-ac57-8915e88ab973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:42:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ff0e1ca6-9e22-4d2a-82d1-c1cc6135b75e tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:33 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb 1G Jun 16 08:42:33 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:34 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ff0e1ca6-9e22-4d2a-82d1-c1cc6135b75e tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb 1G" returned: 0 in 1.011s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ff0e1ca6-9e22-4d2a-82d1-c1cc6135b75e tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:34 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb Jun 16 08:42:34 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:42:35 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ff0e1ca6-9e22-4d2a-82d1-c1cc6135b75e tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb" returned: 0 in 0.843s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:35 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-ff0e1ca6-9e22-4d2a-82d1-c1cc6135b75e tempest-SnapshotsActionsTest-1448315170 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb is being set with open permissions: ugo+rw Jun 16 08:42:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ff0e1ca6-9e22-4d2a-82d1-c1cc6135b75e tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:35 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb Jun 16 08:42:35 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:35 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ff0e1ca6-9e22-4d2a-82d1-c1cc6135b75e tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb" returned: 0 in 0.728s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ff0e1ca6-9e22-4d2a-82d1-c1cc6135b75e tempest-SnapshotsActionsTest-1448315170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.491s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:42:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.793s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:42:35 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Cloning volume 8887acc6-d539-45e7-8a02-34fed3b8d7ed to volume dfe60718-999b-4ad4-82b8-d9b4bb71be4c Jun 16 08:42:35 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ff0e1ca6-9e22-4d2a-82d1-c1cc6135b75e tempest-SnapshotsActionsTest-1448315170 None] Create snapshot completed successfully Jun 16 08:42:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Creating offline snapshot c3f567ca-dd8b-4467-8098-b243c9484a46 of volume 8887acc6-d539-45e7-8a02-34fed3b8d7ed {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:42:35 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4fb4d1-91a0-4963-b6f6-37c8847c8e4f]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:36 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed Jun 16 08:42:36 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:36 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Acquiring lock "cinder-8081cae3-8171-4d1b-afe8-21cbd8528eeb-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:36 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-8081cae3-8171-4d1b-afe8-21cbd8528eeb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:36 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Acquiring lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:36 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" acquired by "delete_snapshot" :: waited 0.038s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:36 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Acquiring lock "cinder-quobyte-8081cae3-8171-4d1b-afe8-21cbd8528eeb" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:36 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed" returned: 0 in 0.795s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:36 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-quobyte-8081cae3-8171-4d1b-afe8-21cbd8528eeb" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Deleting offline snapshot 8081cae3-8171-4d1b-afe8-21cbd8528eeb of volume 0cc7866d-5255-4e7e-ac57-8915e88ab973 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:42:36 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46 1G Jun 16 08:42:36 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] snapshot_file for this snap is: volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:42:36 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2286fb1a-ee4c-4fef-9228-2e300597e354]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:36 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb Jun 16 08:42:36 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:37 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb" returned: 0 in 0.754s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc7866d-5255-4e7e-ac57-8915e88ab973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:42:37 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:37 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e3a1fa-a339-4405-8fa3-323f00868f55]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46 1G" returned: 0 in 0.851s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:37 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46 Jun 16 08:42:37 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:37 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 Jun 16 08:42:37 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:38 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46" returned: 0 in 0.748s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:38 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46 is being set with open permissions: ugo+rw: NotImplementedError Jun 16 08:42:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:38 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46 Jun 16 08:42:38 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:38 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775" returned: 0 in 1.102s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc7866d-5255-4e7e-ac57-8915e88ab973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:42:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:38 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb Jun 16 08:42:38 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:39 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46" returned: 0 in 0.843s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:39 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.info Jun 16 08:42:39 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:39 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb" returned: 0 in 1.116s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:39 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb Jun 16 08:42:39 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:40 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.info" returned: 0 in 0.935s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:40 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.info is being set with open permissions: ugo+rw: NotImplementedError Jun 16 08:42:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:40 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.info Jun 16 08:42:40 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:40 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.8081cae3-8171-4d1b-afe8-21cbd8528eeb" returned: 0 in 0.794s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:40 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-quobyte-8081cae3-8171-4d1b-afe8-21cbd8528eeb" released by "_delete_snapshot" :: held 3.870s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:40 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" released by "delete_snapshot" :: held 3.912s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:40 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Created reservations ['fdc8adc6-c9dc-4fd5-8a9d-b65f8a0bf856', '97ed3a99-45eb-4a41-b535-d39e4f942414', '1be994d5-85f6-4ad7-965f-c38c953e5e95', 'e5fa8162-25a9-4965-9ec1-2cd2901fcfd2'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:42:40 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Delete snapshot completed successfully. Jun 16 08:42:40 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-dccb2fdc-0d3e-4c7f-adee-1dc6c35b2a92 tempest-SnapshotsActionsTest-1877730609 None] Lock "cinder-8081cae3-8171-4d1b-afe8-21cbd8528eeb-delete_snapshot" released by "delete_snapshot" :: held 4.100s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:40 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.info" returned: 0 in 0.796s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:40 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Acquiring lock "cinder-quobyte-dfe60718-999b-4ad4-82b8-d9b4bb71be4c" by "_copy_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Lock "cinder-quobyte-dfe60718-999b-4ad4-82b8-d9b4bb71be4c" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] snapshot: c3f567ca-dd8b-4467-8098-b243c9484a46, volume: dfe60718-999b-4ad4-82b8-d9b4bb71be4c, {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad64f67-8d14-416b-8f71-630d35ee1c79]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:41 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46 Jun 16 08:42:41 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] Acquiring lock "cinder-2827bdd3-e8a8-4b72-bb76-e9c21baed775-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] Lock "cinder-2827bdd3-e8a8-4b72-bb76-e9c21baed775-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] Acquiring lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] Lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] Acquiring lock "cinder-quobyte-2827bdd3-e8a8-4b72-bb76-e9c21baed775" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] Lock "cinder-quobyte-2827bdd3-e8a8-4b72-bb76-e9c21baed775" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] Deleting offline snapshot 2827bdd3-e8a8-4b72-bb76-e9c21baed775 of volume 0cc7866d-5255-4e7e-ac57-8915e88ab973 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] snapshot_file for this snap is: volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e50213-67fb-4401-9c4d-456e65447a68]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:41 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 Jun 16 08:42:41 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:41 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46" returned: 0 in 0.780s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Creating direct copy from snapshot {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[acac3d31-8716-4175-8aab-9332c26be0d8]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:42 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed Jun 16 08:42:42 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:42 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775" returned: 0 in 0.794s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc7866d-5255-4e7e-ac57-8915e88ab973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:42:42 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[33529d57-9a04-4e95-91c9-a8f4a7838221]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:42 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973 Jun 16 08:42:42 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:42 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed" returned: 0 in 0.757s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:42 devstack cinder-volume[92348]: DEBUG cinder.utils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Path /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dfe60718-999b-4ad4-82b8-d9b4bb71be4c not found in is_blk_device check {{(pid=92348) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 16 08:42:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dfe60718-999b-4ad4-82b8-d9b4bb71be4c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:42 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dfe60718-999b-4ad4-82b8-d9b4bb71be4c Jun 16 08:42:42 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:43 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973" returned: 0 in 0.727s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:43 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 Jun 16 08:42:43 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:44 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775" returned: 0 in 1.024s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:44 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775 Jun 16 08:42:44 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973.2827bdd3-e8a8-4b72-bb76-e9c21baed775" returned: 0 in 1.196s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:45 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:45 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] Lock "cinder-quobyte-2827bdd3-e8a8-4b72-bb76-e9c21baed775" released by "_delete_snapshot" :: held 3.960s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:45 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] Lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" released by "delete_snapshot" :: held 4.004s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:45 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] Created reservations ['dc79d933-131e-4e17-8236-d979b987a49b', '0e9decfd-43dd-4a12-ab73-498794c5cc2e', 'a13ffb6c-f6c2-4f89-9d8e-b3b3b23c927f', '65da8d27-83a3-4b26-881f-5a0ff070c2cf'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:42:45 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] Delete snapshot completed successfully. Jun 16 08:42:45 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-745cb164-0e89-4f7a-b198-083afd005199 tempest-SnapshotsActionsTest-1448315170 None] Lock "cinder-2827bdd3-e8a8-4b72-bb76-e9c21baed775-delete_snapshot" released by "delete_snapshot" :: held 4.455s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] Acquiring lock "cinder-0cc7866d-5255-4e7e-ac57-8915e88ab973-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] Lock "cinder-0cc7866d-5255-4e7e-ac57-8915e88ab973-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] Acquiring lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] Lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" acquired by "delete_volume" :: waited 0.063s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:47 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ccc40b-ee54-4956-857f-538acd395685]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:47 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973 Jun 16 08:42:47 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973" returned: 0 in 2.183s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:49 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:49 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973 Jun 16 08:42:49 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:50 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dfe60718-999b-4ad4-82b8-d9b4bb71be4c" returned: 0 in 7.445s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:50 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6215fb87-b2fc-4a8f-9f50-6dda1b7204cf]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:50 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed Jun 16 08:42:50 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:50 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0cc7866d-5255-4e7e-ac57-8915e88ab973" returned: 0 in 1.183s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:51 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] Lock "cinder-quobyte-0cc7866d-5255-4e7e-ac57-8915e88ab973" released by "delete_volume" :: held 3.569s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:51 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] Created reservations ['f325a657-9448-44c0-8eb0-f828e1645ee3', '03bf949a-012f-4646-bc5c-eefefd9d2ce4', '9a9b7df4-5b3d-432e-8084-1730ab12d56d', 'c7c24e6f-7441-400e-b286-59dcdeeb5b14'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:42:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:42:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:42:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:42:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:42:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:42:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:51 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:42:51 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:51 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed" returned: 0 in 1.553s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:51 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed, size 1024.00 MB, duration 7.45 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dfe60718-999b-4ad4-82b8-d9b4bb71be4c {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:42:51 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Converted 1024.00 MB image at 137.50 MB/s Jun 16 08:42:51 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dfe60718-999b-4ad4-82b8-d9b4bb71be4c is being set with open permissions: ugo+rw: NotImplementedError Jun 16 08:42:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dfe60718-999b-4ad4-82b8-d9b4bb71be4c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:51 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dfe60718-999b-4ad4-82b8-d9b4bb71be4c Jun 16 08:42:51 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:51 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.725s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:51 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:42:52 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] Deleted volume successfully. Jun 16 08:42:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5f21279a-3af5-49ba-9813-502980a1ce2f tempest-SnapshotsActionsTest-1448315170 None] Lock "cinder-0cc7866d-5255-4e7e-ac57-8915e88ab973-delete_volume" released by "delete_volume" :: held 4.742s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:52 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dfe60718-999b-4ad4-82b8-d9b4bb71be4c" returned: 0 in 0.913s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Lock "cinder-quobyte-dfe60718-999b-4ad4-82b8-d9b4bb71be4c" released by "_copy_volume_from_snapshot" :: held 11.592s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Acquiring lock "cinder-quobyte-c3f567ca-dd8b-4467-8098-b243c9484a46" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Lock "cinder-quobyte-c3f567ca-dd8b-4467-8098-b243c9484a46" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:52 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Deleting offline snapshot c3f567ca-dd8b-4467-8098-b243c9484a46 of volume 8887acc6-d539-45e7-8a02-34fed3b8d7ed {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:42:52 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] snapshot_file for this snap is: volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:42:52 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[46228be7-3f1d-47e3-833c-468a59e4697f]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:52 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46 Jun 16 08:42:52 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:53 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46" returned: 0 in 1.110s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:42:53 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[67894893-dadd-4e7f-ad7b-5b81308053f9]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:54 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed Jun 16 08:42:54 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:55 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed" returned: 0 in 1.182s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:55 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46 Jun 16 08:42:55 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:56 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46" returned: 0 in 1.612s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:56 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46 Jun 16 08:42:56 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:42:58 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Jun 16 08:42:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed.c3f567ca-dd8b-4467-8098-b243c9484a46" returned: 0 in 1.364s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:42:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Lock "cinder-quobyte-c3f567ca-dd8b-4467-8098-b243c9484a46" released by "_delete_snapshot" :: held 5.440s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:42:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.326s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:42:58 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-5fad9fbb-184a-4c66-b7d5-425a50d17522 tempest-GroupsV314Test-585070636 None] Create group from source-group-ea9c1e58-b744-4309-95d7-86bfcab9f0a3 completed successfully. Jun 16 08:42:59 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] Acquiring lock "cinder-quobyte-dfe60718-999b-4ad4-82b8-d9b4bb71be4c" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:42:59 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] Lock "cinder-quobyte-dfe60718-999b-4ad4-82b8-d9b4bb71be4c" acquired by "delete_volume" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:42:59 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad7b8b5-da00-4d9e-80c4-35d4b8fe4244]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:42:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dfe60718-999b-4ad4-82b8-d9b4bb71be4c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:42:59 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dfe60718-999b-4ad4-82b8-d9b4bb71be4c Jun 16 08:42:59 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:00 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dfe60718-999b-4ad4-82b8-d9b4bb71be4c" returned: 0 in 1.021s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dfe60718-999b-4ad4-82b8-d9b4bb71be4c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:00 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dfe60718-999b-4ad4-82b8-d9b4bb71be4c Jun 16 08:43:00 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:01 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dfe60718-999b-4ad4-82b8-d9b4bb71be4c" returned: 0 in 0.904s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] Lock "cinder-quobyte-dfe60718-999b-4ad4-82b8-d9b4bb71be4c" released by "delete_volume" :: held 2.014s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:43:01 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] Created reservations ['88e0ea48-8c59-493f-a839-5d7ebc634553'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:43:01 devstack cinder-volume[92348]: WARNING cinder.quota [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-393433171 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-393433171, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:43:01 devstack cinder-volume[92348]: WARNING cinder.quota [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-393433171 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-393433171, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:43:01 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] Created reservations ['42897b82-c9a6-4033-b12c-a6ae4ca4c3db', '4768b470-fa1b-4f46-8262-f08b2ca16285', '68d78517-d6a4-42dc-b1c3-cf8f75cb96a2', '92975505-8ce6-4097-bc00-3ee525489ab6'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:43:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:01 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:43:01 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:43:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:01 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:43:01 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] Acquiring lock "cinder-quobyte-8887acc6-d539-45e7-8a02-34fed3b8d7ed" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:43:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] Lock "cinder-quobyte-8887acc6-d539-45e7-8a02-34fed3b8d7ed" acquired by "delete_volume" :: waited 0.033s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:43:02 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27f550e-73fb-47c5-a8b6-5bbfcb55b665]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:43:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:02 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed Jun 16 08:43:02 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:03 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.227s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:03 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:43:03 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-228ba195-ddaf-4b94-a2eb-8fc2f0dd5b8a tempest-GroupsV314Test-585070636 None] Delete group completed successfully. Jun 16 08:43:03 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed" returned: 0 in 1.361s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:03 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed Jun 16 08:43:03 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:04 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8887acc6-d539-45e7-8a02-34fed3b8d7ed" returned: 0 in 0.727s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:04 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] Lock "cinder-quobyte-8887acc6-d539-45e7-8a02-34fed3b8d7ed" released by "delete_volume" :: held 2.207s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:43:04 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] Created reservations ['4bc5fd7b-e2b5-4e66-b0cd-8326009991e1'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:43:04 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] Created reservations ['645405be-e6f5-46f8-a97c-2df1634482d8', 'd6ef3bd5-f6b6-4329-a30c-a16d1250270b', 'cafa6087-7b4c-4513-8b40-231a0635bb33', '7cbefeaa-880d-4718-8d4e-6d641affea35'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:43:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:04 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:43:04 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:43:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:05 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:43:05 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Flow 'volume_create_manager' (c0e61116-b504-40af-8312-eb6d26dd44b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6010be5a-81b2-4647-9c6f-f3f7c2181d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6010be5a-81b2-4647-9c6f-f3f7c2181d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1406108108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35217d2-47a8-4b17-98dc-1a5910f863a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86161dc67054a218571eb3f007784d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:43:05Z,use_quota=True,user_id='e5594ab06ba942829a7f2a41b95b09c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385d8ff5-ed30-4906-a560-9b998d4a1fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385d8ff5-ed30-4906-a560-9b998d4a1fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467f7cd8-b2ff-4001-bb95-9b43a22a7043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467f7cd8-b2ff-4001-bb95-9b43a22a7043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f35217d2-47a8-4b17-98dc-1a5910f863a7', 'volume_name': 'volume-f35217d2-47a8-4b17-98dc-1a5910f863a7', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6724a4c7-5431-4d57-9d50-bfe47cf15a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6724a4c7-5431-4d57-9d50-bfe47cf15a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea568baf-43d4-4895-a316-3895b333a39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:05 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Volume f35217d2-47a8-4b17-98dc-1a5910f863a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f35217d2-47a8-4b17-98dc-1a5910f863a7', 'volume_size': 1} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1406108108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35217d2-47a8-4b17-98dc-1a5910f863a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86161dc67054a218571eb3f007784d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:43:05Z,use_quota=True,user_id='e5594ab06ba942829a7f2a41b95b09c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Creating volume f35217d2-47a8-4b17-98dc-1a5910f863a7 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:43:05 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f35217d2-47a8-4b17-98dc-1a5910f863a7 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:05 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f35217d2-47a8-4b17-98dc-1a5910f863a7 1073741824 Jun 16 08:43:05 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:05 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.787s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:05 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:43:05 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-37de63e9-e522-46ff-a96a-c6bf75a14177 tempest-GroupsV314Test-585070636 None] Delete group completed successfully. Jun 16 08:43:06 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f35217d2-47a8-4b17-98dc-1a5910f863a7 1073741824" returned: 0 in 0.785s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f35217d2-47a8-4b17-98dc-1a5910f863a7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:06 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f35217d2-47a8-4b17-98dc-1a5910f863a7 Jun 16 08:43:06 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:07 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f35217d2-47a8-4b17-98dc-1a5910f863a7" returned: 0 in 0.627s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:43:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea568baf-43d4-4895-a316-3895b333a39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f35217d2-47a8-4b17-98dc-1a5910f863a7', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056347cd-fff0-4038-9db1-0e4d3b485b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:07 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Volume volume-f35217d2-47a8-4b17-98dc-1a5910f863a7 (f35217d2-47a8-4b17-98dc-1a5910f863a7): created successfully Jun 16 08:43:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056347cd-fff0-4038-9db1-0e4d3b485b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Flow 'volume_create_manager' (c0e61116-b504-40af-8312-eb6d26dd44b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:43:07 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-252dc195-4b30-43b2-9006-d59ec364fc94 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Created volume successfully. Jun 16 08:43:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] Acquiring lock "cinder-f35217d2-47a8-4b17-98dc-1a5910f863a7-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:43:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] Lock "cinder-f35217d2-47a8-4b17-98dc-1a5910f863a7-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:43:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] Acquiring lock "cinder-quobyte-f35217d2-47a8-4b17-98dc-1a5910f863a7" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:43:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] Lock "cinder-quobyte-f35217d2-47a8-4b17-98dc-1a5910f863a7" acquired by "delete_volume" :: waited 0.020s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:43:07 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0b7c98-5975-46f1-a527-82b9fd0d528d]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:43:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f35217d2-47a8-4b17-98dc-1a5910f863a7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:07 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f35217d2-47a8-4b17-98dc-1a5910f863a7 Jun 16 08:43:07 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:08 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f35217d2-47a8-4b17-98dc-1a5910f863a7" returned: 0 in 0.743s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f35217d2-47a8-4b17-98dc-1a5910f863a7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:08 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f35217d2-47a8-4b17-98dc-1a5910f863a7 Jun 16 08:43:08 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:09 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f35217d2-47a8-4b17-98dc-1a5910f863a7" returned: 0 in 0.719s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] Lock "cinder-quobyte-f35217d2-47a8-4b17-98dc-1a5910f863a7" released by "delete_volume" :: held 1.514s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:43:09 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] Created reservations ['65d950ab-21cb-492b-ba15-d77f2bbc4afa', '69c36f2a-42ca-401d-9915-934e0f51afe5', 'a6c4a463-816c-4295-b062-170571b90955', '1162f733-bf51-4114-a7cf-bda1aef176b3'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:43:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:09 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:43:09 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:43:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:09 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:43:09 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:10 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.882s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:43:10 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] Deleted volume successfully. Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9509ba99-fccc-4344-802d-674849845a4e tempest-VolumeQuotasAdminTestJSON-1308559712 None] Lock "cinder-f35217d2-47a8-4b17-98dc-1a5910f863a7-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Flow 'volume_create_manager' (bf72a75b-4ebb-45b4-9819-5522b4bcf538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5747d3-6b7a-48a0-86ce-463e3c843196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5747d3-6b7a-48a0-86ce-463e3c843196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1465777431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca141f0-73f8-40b6-a72e-210c5bf0d188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86161dc67054a218571eb3f007784d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:43:11Z,use_quota=True,user_id='e5594ab06ba942829a7f2a41b95b09c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba669c8-9130-499c-9692-0bfc82463d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba669c8-9130-499c-9692-0bfc82463d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b1ab0d-8345-4f70-aee1-af26f264c050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b1ab0d-8345-4f70-aee1-af26f264c050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dca141f0-73f8-40b6-a72e-210c5bf0d188', 'volume_name': 'volume-dca141f0-73f8-40b6-a72e-210c5bf0d188', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ce4f7e-ff34-43c6-9ee4-9d9b0db4e6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ce4f7e-ff34-43c6-9ee4-9d9b0db4e6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35355cad-ab52-41c2-9aca-87b397bbc004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:10 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Volume dca141f0-73f8-40b6-a72e-210c5bf0d188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dca141f0-73f8-40b6-a72e-210c5bf0d188', 'volume_size': 1} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1465777431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca141f0-73f8-40b6-a72e-210c5bf0d188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86161dc67054a218571eb3f007784d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:43:11Z,use_quota=True,user_id='e5594ab06ba942829a7f2a41b95b09c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Creating volume dca141f0-73f8-40b6-a72e-210c5bf0d188 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:43:10 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:43:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dca141f0-73f8-40b6-a72e-210c5bf0d188 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:10 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dca141f0-73f8-40b6-a72e-210c5bf0d188 1073741824 Jun 16 08:43:10 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:11 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dca141f0-73f8-40b6-a72e-210c5bf0d188 1073741824" returned: 0 in 0.851s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dca141f0-73f8-40b6-a72e-210c5bf0d188 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:11 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dca141f0-73f8-40b6-a72e-210c5bf0d188 Jun 16 08:43:11 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:12 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-b594172b-2259-4075-a437-c47fc563cac9 tempest-GroupsV320Test-879212932 None] Group tempest-GroupsV320Test-Group-2068747992: creating Jun 16 08:43:12 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-b594172b-2259-4075-a437-c47fc563cac9 tempest-GroupsV320Test-879212932 None] Group tempest-GroupsV320Test-Group-2068747992: created successfully Jun 16 08:43:12 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-b594172b-2259-4075-a437-c47fc563cac9 tempest-GroupsV320Test-879212932 None] Create group completed successfully. Jun 16 08:43:12 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dca141f0-73f8-40b6-a72e-210c5bf0d188" returned: 0 in 0.592s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:43:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35355cad-ab52-41c2-9aca-87b397bbc004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dca141f0-73f8-40b6-a72e-210c5bf0d188', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (badaf13d-0127-4755-a326-e07ee492547c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:12 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Volume volume-dca141f0-73f8-40b6-a72e-210c5bf0d188 (dca141f0-73f8-40b6-a72e-210c5bf0d188): created successfully Jun 16 08:43:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (badaf13d-0127-4755-a326-e07ee492547c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Flow 'volume_create_manager' (bf72a75b-4ebb-45b4-9819-5522b4bcf538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:43:12 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-e8c10eef-6d1d-4a48-ac28-f6e178780934 tempest-VolumeQuotasAdminTestJSON-1308559712 None] Created volume successfully. Jun 16 08:43:13 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-203e83cc-4de3-49fc-ad7c-529072718611 tempest-VolumeQuotasAdminTestJSON-624809315 None] Transfer volume completed successfully. Jun 16 08:43:13 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-3b7b7c66-e570-4458-b4a3-5cecbad44a28 tempest-GroupsV320Test-879212932 None] Created reservations ['8a2900b2-ff9f-4a22-969c-2a7f0b0d2bd1'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:43:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3b7b7c66-e570-4458-b4a3-5cecbad44a28 tempest-GroupsV320Test-879212932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3b7b7c66-e570-4458-b4a3-5cecbad44a28 tempest-GroupsV320Test-879212932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3b7b7c66-e570-4458-b4a3-5cecbad44a28 tempest-GroupsV320Test-879212932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:43:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3b7b7c66-e570-4458-b4a3-5cecbad44a28 tempest-GroupsV320Test-879212932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:43:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3b7b7c66-e570-4458-b4a3-5cecbad44a28 tempest-GroupsV320Test-879212932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3b7b7c66-e570-4458-b4a3-5cecbad44a28 tempest-GroupsV320Test-879212932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:13 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:43:13 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:14 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3b7b7c66-e570-4458-b4a3-5cecbad44a28 tempest-GroupsV320Test-879212932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.592s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:14 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-3b7b7c66-e570-4458-b4a3-5cecbad44a28 tempest-GroupsV320Test-879212932 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:43:14 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-3b7b7c66-e570-4458-b4a3-5cecbad44a28 tempest-GroupsV320Test-879212932 None] Delete group completed successfully. Jun 16 08:43:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] Acquiring lock "cinder-dca141f0-73f8-40b6-a72e-210c5bf0d188-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:43:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] Lock "cinder-dca141f0-73f8-40b6-a72e-210c5bf0d188-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:43:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] Acquiring lock "cinder-quobyte-dca141f0-73f8-40b6-a72e-210c5bf0d188" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:43:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] Lock "cinder-quobyte-dca141f0-73f8-40b6-a72e-210c5bf0d188" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:43:14 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df0bc33-8fc2-46ab-a6a8-9c1ad80701b5]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:43:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dca141f0-73f8-40b6-a72e-210c5bf0d188 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:14 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dca141f0-73f8-40b6-a72e-210c5bf0d188 Jun 16 08:43:14 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:15 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dca141f0-73f8-40b6-a72e-210c5bf0d188" returned: 0 in 0.745s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dca141f0-73f8-40b6-a72e-210c5bf0d188 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:15 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dca141f0-73f8-40b6-a72e-210c5bf0d188 Jun 16 08:43:15 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:15 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dca141f0-73f8-40b6-a72e-210c5bf0d188" returned: 0 in 0.698s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] Lock "cinder-quobyte-dca141f0-73f8-40b6-a72e-210c5bf0d188" released by "delete_volume" :: held 1.491s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:43:15 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] Created reservations ['c7fdd703-d842-4423-8cda-bb541184d056', '436d25bf-d1ca-496c-98dc-663c65e934ce', 'b829d916-3c0e-4e34-b36f-f6270654b4a0', '5bde6104-9479-4e4e-8b3c-72c5ee808bb2'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:43:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:15 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:43:15 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:43:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:15 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:43:15 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Flow 'volume_create_manager' (757d111c-3656-4b3c-a24d-d91844a5abbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6043e9a-4e8a-4f4a-be4e-92f92b209325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:16 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6043e9a-4e8a-4f4a-be4e-92f92b209325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1076376338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce398028-b899-4ea6-a1d2-d4f9b30e25a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0936d74a440346758843c312a959ac69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:43:16Z,use_quota=True,user_id='2360f7a0152e429ba4ca175cef2a9559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d2298b-ca47-4a68-8fde-eef4b27c23b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d2298b-ca47-4a68-8fde-eef4b27c23b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c0ffec-2515-4e1e-aae8-a895f0fc708d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c0ffec-2515-4e1e-aae8-a895f0fc708d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce398028-b899-4ea6-a1d2-d4f9b30e25a7', 'volume_name': 'volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c076b3-a7c8-4671-8733-e2a7446ed664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c076b3-a7c8-4671-8733-e2a7446ed664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f3248e3-bafc-44ab-9def-bd9ef28760af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:16 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Volume ce398028-b899-4ea6-a1d2-d4f9b30e25a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7', 'volume_size': 1} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1076376338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce398028-b899-4ea6-a1d2-d4f9b30e25a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0936d74a440346758843c312a959ac69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:43:16Z,use_quota=True,user_id='2360f7a0152e429ba4ca175cef2a9559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Creating volume ce398028-b899-4ea6-a1d2-d4f9b30e25a7 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:43:16 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.869s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:43:16 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] Deleted volume successfully. Jun 16 08:43:16 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7 1073741824 Jun 16 08:43:16 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-28141002-7a53-431c-bf45-7372dac3ded9 tempest-VolumeQuotasAdminTestJSON-60658497 None] Lock "cinder-dca141f0-73f8-40b6-a72e-210c5bf0d188-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:43:17 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7 1073741824" returned: 0 in 1.078s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:17 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7 Jun 16 08:43:17 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:18 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7" returned: 0 in 0.988s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:18 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] <== create_volume: return (2124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:43:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:18 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f3248e3-bafc-44ab-9def-bd9ef28760af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:18 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c621fc1c-54e2-4f8f-b337-fe7c36b553b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:18 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Volume volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7 (ce398028-b899-4ea6-a1d2-d4f9b30e25a7): created successfully Jun 16 08:43:18 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c621fc1c-54e2-4f8f-b337-fe7c36b553b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:18 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Flow 'volume_create_manager' (757d111c-3656-4b3c-a24d-d91844a5abbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:43:19 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-07fca0bb-a4b2-42a9-9766-859d3ca89e33 tempest-ServerActionsTestOtherA-233125094 None] Created volume successfully. Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Flow 'volume_create_manager' (7374864a-ffc8-47d8-af4c-b210e30860cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b594fede-cb36-4424-9a42-d2a4125d9680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b594fede-cb36-4424-9a42-d2a4125d9680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-789867365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='502fba564e224f2fa3dd19c63e97de73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:43:24Z,use_quota=True,user_id='22101aa960214902af45c7b53c7dc8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86112427-b08b-4b2f-b42b-277fc493e474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86112427-b08b-4b2f-b42b-277fc493e474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b6a779-120e-496a-95fe-881cb078bc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b6a779-120e-496a-95fe-881cb078bc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2', 'volume_name': 'volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1306d2-71b9-4926-8e31-1e275d4e9b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1306d2-71b9-4926-8e31-1e275d4e9b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e006111b-7613-4237-a1ca-ea76b3f19297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:24 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Volume 29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2', 'volume_size': 1} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-789867365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='502fba564e224f2fa3dd19c63e97de73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:43:24Z,use_quota=True,user_id='22101aa960214902af45c7b53c7dc8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Creating volume 29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:43:24 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:43:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:24 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2 1073741824 Jun 16 08:43:24 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:25 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2 1073741824" returned: 0 in 1.017s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:25 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2 Jun 16 08:43:25 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:25 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:43:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Flow 'volume_create_manager' (40369d98-d10a-4a01-9479-618587cb0b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:43:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eeef0be-d401-4869-9208-1e7b9d19149e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eeef0be-d401-4869-9208-1e7b9d19149e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2003152040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88bc0680-0f8c-4ea4-b933-bea9b3be47b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafef223eb7d4580a36039f7838adde1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:43:26Z,use_quota=True,user_id='491a8619f70d4f20945720a0092919ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675a87ea-61be-4a0a-938e-e094f278e5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675a87ea-61be-4a0a-938e-e094f278e5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ad1770-9eab-4432-9d43-3d717d8fcc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ad1770-9eab-4432-9d43-3d717d8fcc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88bc0680-0f8c-4ea4-b933-bea9b3be47b2', 'volume_name': 'volume-88bc0680-0f8c-4ea4-b933-bea9b3be47b2', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cb128d-9eb6-47cd-8195-1d49b19746b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cb128d-9eb6-47cd-8195-1d49b19746b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aebe2a1c-f914-450b-bf30-0ec1606225de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:25 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Volume 88bc0680-0f8c-4ea4-b933-bea9b3be47b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88bc0680-0f8c-4ea4-b933-bea9b3be47b2', 'volume_size': 1} Jun 16 08:43:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:26 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2" returned: 0 in 0.802s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:43:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.310s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2003152040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88bc0680-0f8c-4ea4-b933-bea9b3be47b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafef223eb7d4580a36039f7838adde1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:43:26Z,use_quota=True,user_id='491a8619f70d4f20945720a0092919ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:43:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Creating volume 88bc0680-0f8c-4ea4-b933-bea9b3be47b2 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:43:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:43:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:43:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:43:26 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:43:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-88bc0680-0f8c-4ea4-b933-bea9b3be47b2 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e006111b-7613-4237-a1ca-ea76b3f19297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:26 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-88bc0680-0f8c-4ea4-b933-bea9b3be47b2 1073741824 Jun 16 08:43:26 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95df2460-b37c-4551-8f05-2cd9f6026b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:26 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Volume volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2 (29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2): created successfully Jun 16 08:43:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95df2460-b37c-4551-8f05-2cd9f6026b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Flow 'volume_create_manager' (7374864a-ffc8-47d8-af4c-b210e30860cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:43:26 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-7aa3269e-4f4e-4c2b-b928-24b83449b06f tempest-AttachVolumeShelveTestJSON-502799397 None] Created volume successfully. Jun 16 08:43:27 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-88bc0680-0f8c-4ea4-b933-bea9b3be47b2 1073741824" returned: 0 in 1.248s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:27 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=76,cinder:UPDATE=86,cinder:DELETE=5,cinder:INSERT=18 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:43:27 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=77,cinder:UPDATE=90,cinder:INSERT=24,cinder:DELETE=5 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:43:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-88bc0680-0f8c-4ea4-b933-bea9b3be47b2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:27 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-88bc0680-0f8c-4ea4-b933-bea9b3be47b2 Jun 16 08:43:27 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:28 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-88bc0680-0f8c-4ea4-b933-bea9b3be47b2" returned: 0 in 0.778s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:43:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aebe2a1c-f914-450b-bf30-0ec1606225de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88bc0680-0f8c-4ea4-b933-bea9b3be47b2', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0d4379-9dfb-4969-bec0-adf8cc5da594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:28 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Volume volume-88bc0680-0f8c-4ea4-b933-bea9b3be47b2 (88bc0680-0f8c-4ea4-b933-bea9b3be47b2): created successfully Jun 16 08:43:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0d4379-9dfb-4969-bec0-adf8cc5da594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Flow 'volume_create_manager' (40369d98-d10a-4a01-9479-618587cb0b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:43:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-6a48936b-d1e9-481a-b8ef-adf95f941650 tempest-VolumesServicesTestJSON-1667229055 None] Created volume successfully. Jun 16 08:43:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] Acquiring lock "cinder-88bc0680-0f8c-4ea4-b933-bea9b3be47b2-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:43:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] Lock "cinder-88bc0680-0f8c-4ea4-b933-bea9b3be47b2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:43:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] Acquiring lock "cinder-quobyte-88bc0680-0f8c-4ea4-b933-bea9b3be47b2" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:43:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] Lock "cinder-quobyte-88bc0680-0f8c-4ea4-b933-bea9b3be47b2" acquired by "delete_volume" :: waited 0.023s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:43:29 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[da39b380-cba7-479c-adaa-c6bb0525732b]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:43:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-88bc0680-0f8c-4ea4-b933-bea9b3be47b2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:29 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-88bc0680-0f8c-4ea4-b933-bea9b3be47b2 Jun 16 08:43:29 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:43:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:43:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:43:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:30 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:43:30 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:30 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-88bc0680-0f8c-4ea4-b933-bea9b3be47b2" returned: 0 in 1.164s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-88bc0680-0f8c-4ea4-b933-bea9b3be47b2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:30 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-88bc0680-0f8c-4ea4-b933-bea9b3be47b2 Jun 16 08:43:30 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:31 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.945s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:31 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:43:31 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:43:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 8 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:43:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:43:31 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-88bc0680-0f8c-4ea4-b933-bea9b3be47b2" returned: 0 in 0.789s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:31 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] Lock "cinder-quobyte-88bc0680-0f8c-4ea4-b933-bea9b3be47b2" released by "delete_volume" :: held 2.004s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:43:31 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] Created reservations ['63adb3f2-56c8-4af6-a14d-f9144d649a3c', '7d4b81bf-0832-44ec-9c8b-3a6f847eb984', '0a1cc8fd-9796-4ddc-b466-18bd987fd58f', '653cf317-bdd6-4f30-8b49-66aeb849535f'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:43:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:31 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:43:31 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:43:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:31 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:43:31 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:32 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.753s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:32 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:43:32 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] Deleted volume successfully. Jun 16 08:43:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0245f5f5-00c1-40e9-8ee0-52f49a98cae9 tempest-VolumesServicesTestJSON-1667229055 None] Lock "cinder-88bc0680-0f8c-4ea4-b933-bea9b3be47b2-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Flow 'volume_create_manager' (516cd750-e7f6-4791-a98f-9c83906a688a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd41006-cb80-43b8-9884-0a88a6cc4487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd41006-cb80-43b8-9884-0a88a6cc4487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1337358120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be03d69-825b-48ec-a389-f9a09b797d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b74707175849b9be3554133663a213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:43:36Z,use_quota=True,user_id='3340877d1f9648b6b148c0ca9d6b213f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fe2e49-2bd9-452d-813d-28ba7f1b8d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fe2e49-2bd9-452d-813d-28ba7f1b8d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2821cb9-59d8-401b-b3f4-6c73459a6efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2821cb9-59d8-401b-b3f4-6c73459a6efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6be03d69-825b-48ec-a389-f9a09b797d96', 'volume_name': 'volume-6be03d69-825b-48ec-a389-f9a09b797d96', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e68e03-b6b0-4bb1-a7b0-ff8bb0589acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e68e03-b6b0-4bb1-a7b0-ff8bb0589acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cced277d-e546-4a5f-8154-027225e13c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:35 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Volume 6be03d69-825b-48ec-a389-f9a09b797d96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6be03d69-825b-48ec-a389-f9a09b797d96', 'volume_size': 1} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1337358120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be03d69-825b-48ec-a389-f9a09b797d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b74707175849b9be3554133663a213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:43:36Z,use_quota=True,user_id='3340877d1f9648b6b148c0ca9d6b213f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Creating volume 6be03d69-825b-48ec-a389-f9a09b797d96 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:43:35 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:43:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6be03d69-825b-48ec-a389-f9a09b797d96 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:36 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6be03d69-825b-48ec-a389-f9a09b797d96 1073741824 Jun 16 08:43:36 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:37 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6be03d69-825b-48ec-a389-f9a09b797d96 1073741824" returned: 0 in 1.404s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6be03d69-825b-48ec-a389-f9a09b797d96 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:37 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6be03d69-825b-48ec-a389-f9a09b797d96 Jun 16 08:43:37 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:38 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6be03d69-825b-48ec-a389-f9a09b797d96" returned: 0 in 0.959s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] <== create_volume: return (2456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:43:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.461s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cced277d-e546-4a5f-8154-027225e13c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6be03d69-825b-48ec-a389-f9a09b797d96', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (652f96e2-22c3-4d6c-82c9-eee3ed5cc123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:38 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Volume volume-6be03d69-825b-48ec-a389-f9a09b797d96 (6be03d69-825b-48ec-a389-f9a09b797d96): created successfully Jun 16 08:43:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (652f96e2-22c3-4d6c-82c9-eee3ed5cc123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Flow 'volume_create_manager' (516cd750-e7f6-4791-a98f-9c83906a688a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:43:38 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-b23a4f08-2b62-479f-bec5-41097c6af35b tempest-AbsoluteLimitsTests-2002112000 None] Created volume successfully. Jun 16 08:43:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] Acquiring lock "cinder-6be03d69-825b-48ec-a389-f9a09b797d96-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:43:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] Lock "cinder-6be03d69-825b-48ec-a389-f9a09b797d96-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:43:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] Acquiring lock "cinder-quobyte-6be03d69-825b-48ec-a389-f9a09b797d96" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:43:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] Lock "cinder-quobyte-6be03d69-825b-48ec-a389-f9a09b797d96" acquired by "delete_volume" :: waited 0.038s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:43:39 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6b0081-d12f-4b55-b194-0b9d966776f2]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:43:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6be03d69-825b-48ec-a389-f9a09b797d96 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:39 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6be03d69-825b-48ec-a389-f9a09b797d96 Jun 16 08:43:39 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:40 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6be03d69-825b-48ec-a389-f9a09b797d96" returned: 0 in 0.969s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6be03d69-825b-48ec-a389-f9a09b797d96 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:40 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6be03d69-825b-48ec-a389-f9a09b797d96 Jun 16 08:43:40 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:41 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6be03d69-825b-48ec-a389-f9a09b797d96" returned: 0 in 0.910s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] Lock "cinder-quobyte-6be03d69-825b-48ec-a389-f9a09b797d96" released by "delete_volume" :: held 1.957s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:43:41 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] Created reservations ['57b96e5a-e7ae-4d5d-9aaf-cfc5a1b25c3f', '5c5c6292-9f16-426e-86a6-dc7dde56c88b', '471e9d7d-cf21-4cef-ab1a-f50eedbe7b37', '5b92f5b7-01c6-416d-8bb0-67416f94b237'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:43:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:43:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:43:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:41 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:43:41 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:42 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.014s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:42 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:43:42 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] Deleted volume successfully. Jun 16 08:43:42 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e686a96a-a0fe-47b5-9381-8441a864766b tempest-AbsoluteLimitsTests-2002112000 None] Lock "cinder-6be03d69-825b-48ec-a389-f9a09b797d96-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:43:51 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=22,cinder:DELETE=3 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:43:52 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:UPDATE=20,cinder:SELECT=14,cinder:INSERT=7,cinder:DELETE=1 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:43:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-a18fb52e-e58e-424f-be50-e2e629513f44 req-b70b4e1b-1587-4a26-a066-afa95e0a683d tempest-AttachVolumeShelveTestJSON-502799397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-a18fb52e-e58e-424f-be50-e2e629513f44 req-b70b4e1b-1587-4a26-a066-afa95e0a683d tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:52 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d7b8f3-f7a3-4801-8fd6-2d23f372653a]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:43:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-a18fb52e-e58e-424f-be50-e2e629513f44 req-b70b4e1b-1587-4a26-a066-afa95e0a683d tempest-AttachVolumeShelveTestJSON-502799397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:52 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:43:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Flow 'volume_create_manager' (bed6323e-30bb-4b3e-b195-149bbed42abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:43:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a2bfb9-edd9-43db-b5fd-ce42ce0c26c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a2bfb9-edd9-43db-b5fd-ce42ce0c26c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1659386175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c0d9c46-b690-4488-9847-165b369e69f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e7e4455b244f439b276b99d632b2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:43:53Z,use_quota=True,user_id='111a53241fa34f428e68b8133e2a9e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32301e9e-437a-4d6c-9d25-f1969afc8a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32301e9e-437a-4d6c-9d25-f1969afc8a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f17f9a3-4cef-4cea-a048-9929fe78db44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f17f9a3-4cef-4cea-a048-9929fe78db44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c0d9c46-b690-4488-9847-165b369e69f8', 'volume_name': 'volume-4c0d9c46-b690-4488-9847-165b369e69f8', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13ea0e8-8714-4f11-abf8-a56b9e574799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13ea0e8-8714-4f11-abf8-a56b9e574799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd088f2-aba0-4371-9689-c92701530375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:52 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Volume 4c0d9c46-b690-4488-9847-165b369e69f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c0d9c46-b690-4488-9847-165b369e69f8', 'volume_size': 1} Jun 16 08:43:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:52 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2 Jun 16 08:43:52 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:53 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-a18fb52e-e58e-424f-be50-e2e629513f44 req-b70b4e1b-1587-4a26-a066-afa95e0a683d tempest-AttachVolumeShelveTestJSON-502799397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2" returned: 0 in 0.709s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-a18fb52e-e58e-424f-be50-e2e629513f44 req-b70b4e1b-1587-4a26-a066-afa95e0a683d tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.741s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.608s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1659386175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c0d9c46-b690-4488-9847-165b369e69f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e7e4455b244f439b276b99d632b2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:43:53Z,use_quota=True,user_id='111a53241fa34f428e68b8133e2a9e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:43:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Creating volume 4c0d9c46-b690-4488-9847-165b369e69f8 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:43:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:43:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:43:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:43:53 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:43:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4c0d9c46-b690-4488-9847-165b369e69f8 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:53 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4c0d9c46-b690-4488-9847-165b369e69f8 1073741824 Jun 16 08:43:53 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-a18fb52e-e58e-424f-be50-e2e629513f44 req-b70b4e1b-1587-4a26-a066-afa95e0a683d tempest-AttachVolumeShelveTestJSON-502799397 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '349aa0fe-f82c-4837-94ea-1b1d8cbd9fcc', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:43:53 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-a18fb52e-e58e-424f-be50-e2e629513f44 req-b70b4e1b-1587-4a26-a066-afa95e0a683d tempest-AttachVolumeShelveTestJSON-502799397 None] attachment_update completed successfully. Jun 16 08:43:54 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4c0d9c46-b690-4488-9847-165b369e69f8 1073741824" returned: 0 in 0.901s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4c0d9c46-b690-4488-9847-165b369e69f8 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:54 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4c0d9c46-b690-4488-9847-165b369e69f8 Jun 16 08:43:54 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:55 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4c0d9c46-b690-4488-9847-165b369e69f8" returned: 0 in 0.653s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:43:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd088f2-aba0-4371-9689-c92701530375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c0d9c46-b690-4488-9847-165b369e69f8', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f41ffb0-d39e-41ce-a00d-e519d3a5394c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:43:55 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Volume volume-4c0d9c46-b690-4488-9847-165b369e69f8 (4c0d9c46-b690-4488-9847-165b369e69f8): created successfully Jun 16 08:43:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f41ffb0-d39e-41ce-a00d-e519d3a5394c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:43:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Flow 'volume_create_manager' (bed6323e-30bb-4b3e-b195-149bbed42abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:43:55 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-f018b567-af88-42f1-8b20-522a3fbb5df8 tempest-VolumesTransfersV355Test-1986666424 None] Created volume successfully. Jun 16 08:43:56 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-051c19bd-5b87-4d19-aeb8-6c229e5fdfa6 tempest-VolumesTransfersV355Test-1385177326 None] Transfer volume completed successfully. Jun 16 08:43:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] Acquiring lock "cinder-4c0d9c46-b690-4488-9847-165b369e69f8-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:43:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] Lock "cinder-4c0d9c46-b690-4488-9847-165b369e69f8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:43:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] Acquiring lock "cinder-quobyte-4c0d9c46-b690-4488-9847-165b369e69f8" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:43:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] Lock "cinder-quobyte-4c0d9c46-b690-4488-9847-165b369e69f8" acquired by "delete_volume" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:43:57 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cc1733-2e09-49c9-871c-a09ac0230d7d]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:43:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4c0d9c46-b690-4488-9847-165b369e69f8 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:58 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4c0d9c46-b690-4488-9847-165b369e69f8 Jun 16 08:43:58 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:58 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4c0d9c46-b690-4488-9847-165b369e69f8" returned: 0 in 0.771s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4c0d9c46-b690-4488-9847-165b369e69f8 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:58 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4c0d9c46-b690-4488-9847-165b369e69f8 Jun 16 08:43:58 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:43:59 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Jun 16 08:43:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4c0d9c46-b690-4488-9847-165b369e69f8" returned: 0 in 0.737s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:43:59 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] Lock "cinder-quobyte-4c0d9c46-b690-4488-9847-165b369e69f8" released by "delete_volume" :: held 1.561s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:43:59 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] Created reservations ['44c7139d-4d25-4fa1-9b25-0be36b1a4ceb', '194048f6-1d3f-416c-b10e-9641316c1294', '8cc956f6-f850-469c-a362-3740878b8423', 'd905e8f3-9e83-4f0d-bbcb-af4ca127b830'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:43:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:43:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:43:59 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:43:59 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:43:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:43:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:43:59 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:43:59 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:00 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.734s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:44:00 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] Deleted volume successfully. Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9baf9b92-db74-44a2-8b81-8bf13e2339ca tempest-VolumesTransfersV355Test-337326651 None] Lock "cinder-4c0d9c46-b690-4488-9847-165b369e69f8-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Flow 'volume_create_manager' (a60be5fe-2853-4c56-a66a-c2b06125a591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28cd46f-d956-4a17-9f8e-698035260cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28cd46f-d956-4a17-9f8e-698035260cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1039095669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97fc93b-74d9-4c62-b34f-4b60e97da7f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e7e4455b244f439b276b99d632b2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:44:01Z,use_quota=True,user_id='111a53241fa34f428e68b8133e2a9e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60966820-509c-42d4-a0d7-33ac89ca9ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60966820-509c-42d4-a0d7-33ac89ca9ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4a3548-4fe7-485f-ad71-6dfb0206a089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4a3548-4fe7-485f-ad71-6dfb0206a089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c97fc93b-74d9-4c62-b34f-4b60e97da7f9', 'volume_name': 'volume-c97fc93b-74d9-4c62-b34f-4b60e97da7f9', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213c641d-79be-4eef-a547-59ad919760bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213c641d-79be-4eef-a547-59ad919760bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55639424-c886-4e89-bb0b-6338ab0aef4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:00 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Volume c97fc93b-74d9-4c62-b34f-4b60e97da7f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c97fc93b-74d9-4c62-b34f-4b60e97da7f9', 'volume_size': 1} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1039095669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97fc93b-74d9-4c62-b34f-4b60e97da7f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e7e4455b244f439b276b99d632b2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:44:01Z,use_quota=True,user_id='111a53241fa34f428e68b8133e2a9e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Creating volume c97fc93b-74d9-4c62-b34f-4b60e97da7f9 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:44:00 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:44:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c97fc93b-74d9-4c62-b34f-4b60e97da7f9 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:00 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c97fc93b-74d9-4c62-b34f-4b60e97da7f9 1073741824 Jun 16 08:44:00 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:01 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c97fc93b-74d9-4c62-b34f-4b60e97da7f9 1073741824" returned: 0 in 0.792s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c97fc93b-74d9-4c62-b34f-4b60e97da7f9 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:01 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c97fc93b-74d9-4c62-b34f-4b60e97da7f9 Jun 16 08:44:01 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:02 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c97fc93b-74d9-4c62-b34f-4b60e97da7f9" returned: 0 in 0.678s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:44:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55639424-c886-4e89-bb0b-6338ab0aef4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c97fc93b-74d9-4c62-b34f-4b60e97da7f9', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb7a9cc-b2ee-40ac-9a29-8c8babff7d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:02 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Volume volume-c97fc93b-74d9-4c62-b34f-4b60e97da7f9 (c97fc93b-74d9-4c62-b34f-4b60e97da7f9): created successfully Jun 16 08:44:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb7a9cc-b2ee-40ac-9a29-8c8babff7d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Flow 'volume_create_manager' (a60be5fe-2853-4c56-a66a-c2b06125a591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:44:02 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-373f6c84-5166-4b67-9b64-26fb076bec46 tempest-VolumesTransfersV355Test-1986666424 None] Created volume successfully. Jun 16 08:44:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] Acquiring lock "cinder-c97fc93b-74d9-4c62-b34f-4b60e97da7f9-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:44:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] Lock "cinder-c97fc93b-74d9-4c62-b34f-4b60e97da7f9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:44:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] Acquiring lock "cinder-quobyte-c97fc93b-74d9-4c62-b34f-4b60e97da7f9" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:44:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] Lock "cinder-quobyte-c97fc93b-74d9-4c62-b34f-4b60e97da7f9" acquired by "delete_volume" :: waited 0.031s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:44:03 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76706de-bc59-40c7-a1a6-ee2735cc2ef6]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:44:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c97fc93b-74d9-4c62-b34f-4b60e97da7f9 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:03 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c97fc93b-74d9-4c62-b34f-4b60e97da7f9 Jun 16 08:44:03 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:04 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c97fc93b-74d9-4c62-b34f-4b60e97da7f9" returned: 0 in 0.883s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c97fc93b-74d9-4c62-b34f-4b60e97da7f9 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:04 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c97fc93b-74d9-4c62-b34f-4b60e97da7f9 Jun 16 08:44:04 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-f24024d5-77ac-462c-8bba-7a765be429cb req-eecbba06-5189-45aa-aefc-c7fdedda2c6f tempest-ServerActionsTestOtherA-233125094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-f24024d5-77ac-462c-8bba-7a765be429cb req-eecbba06-5189-45aa-aefc-c7fdedda2c6f tempest-ServerActionsTestOtherA-233125094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:04 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2f56bb-adcd-4c18-a3f2-08c8eb46628c]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:44:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-f24024d5-77ac-462c-8bba-7a765be429cb req-eecbba06-5189-45aa-aefc-c7fdedda2c6f tempest-ServerActionsTestOtherA-233125094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:04 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7 Jun 16 08:44:04 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:05 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c97fc93b-74d9-4c62-b34f-4b60e97da7f9" returned: 0 in 0.700s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] Lock "cinder-quobyte-c97fc93b-74d9-4c62-b34f-4b60e97da7f9" released by "delete_volume" :: held 1.633s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:44:05 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] Created reservations ['196f5af6-0005-4320-984f-e420e1de912f', '4fa104c3-0fe5-417b-9528-2d155b0ff19d', 'e0d9d397-3f29-4238-8efc-7368f3ac9e8e', '25b6d815-ab3c-4314-9e96-2f0dc691d4ed'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:44:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:44:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:44:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:05 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:44:05 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:05 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-f24024d5-77ac-462c-8bba-7a765be429cb req-eecbba06-5189-45aa-aefc-c7fdedda2c6f tempest-ServerActionsTestOtherA-233125094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7" returned: 0 in 0.831s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-f24024d5-77ac-462c-8bba-7a765be429cb req-eecbba06-5189-45aa-aefc-c7fdedda2c6f tempest-ServerActionsTestOtherA-233125094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.861s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-f24024d5-77ac-462c-8bba-7a765be429cb req-eecbba06-5189-45aa-aefc-c7fdedda2c6f tempest-ServerActionsTestOtherA-233125094 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '619fce50-d9ba-479a-9753-f54961b23a93', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:44:05 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-f24024d5-77ac-462c-8bba-7a765be429cb req-eecbba06-5189-45aa-aefc-c7fdedda2c6f tempest-ServerActionsTestOtherA-233125094 None] attachment_update completed successfully. Jun 16 08:44:05 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.803s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:05 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:44:05 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] Deleted volume successfully. Jun 16 08:44:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e314b31b-c0a4-43ee-b7e8-de0d945501f1 tempest-VolumesTransfersV355Test-337326651 None] Lock "cinder-c97fc93b-74d9-4c62-b34f-4b60e97da7f9-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:44:15 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-b827a571-eb59-4cff-971f-8abf9794a2a8 req-3c9e6b74-2216-477e-9c71-ba17c73996c0 tempest-ServerActionsTestOtherA-233125094 None] Terminate volume connection completed successfully. Jun 16 08:44:15 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-b827a571-eb59-4cff-971f-8abf9794a2a8 req-3c9e6b74-2216-477e-9c71-ba17c73996c0 tempest-ServerActionsTestOtherA-233125094 None] Deleting attachment 619fce50-d9ba-479a-9753-f54961b23a93. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:44:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-b827a571-eb59-4cff-971f-8abf9794a2a8 req-59ee7c64-c62a-4e14-9bbd-68c719c5ee66 tempest-ServerActionsTestOtherA-233125094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-b827a571-eb59-4cff-971f-8abf9794a2a8 req-59ee7c64-c62a-4e14-9bbd-68c719c5ee66 tempest-ServerActionsTestOtherA-233125094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:18 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1af691-cd0c-4161-947c-b5eb0543f380]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:44:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-b827a571-eb59-4cff-971f-8abf9794a2a8 req-59ee7c64-c62a-4e14-9bbd-68c719c5ee66 tempest-ServerActionsTestOtherA-233125094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:18 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7 Jun 16 08:44:18 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:18 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-b827a571-eb59-4cff-971f-8abf9794a2a8 req-59ee7c64-c62a-4e14-9bbd-68c719c5ee66 tempest-ServerActionsTestOtherA-233125094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7" returned: 0 in 0.939s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-b827a571-eb59-4cff-971f-8abf9794a2a8 req-59ee7c64-c62a-4e14-9bbd-68c719c5ee66 tempest-ServerActionsTestOtherA-233125094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.999s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-b827a571-eb59-4cff-971f-8abf9794a2a8 req-59ee7c64-c62a-4e14-9bbd-68c719c5ee66 tempest-ServerActionsTestOtherA-233125094 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7a3b5c5-b67d-4dd5-95da-1503910487ed', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:44:19 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-b827a571-eb59-4cff-971f-8abf9794a2a8 req-59ee7c64-c62a-4e14-9bbd-68c719c5ee66 tempest-ServerActionsTestOtherA-233125094 None] attachment_update completed successfully. Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Flow 'volume_create_manager' (fef94dbe-35b8-4468-83c6-17a5b584e7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62ee431-5ec5-477a-84fd-cc385c06a16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62ee431-5ec5-477a-84fd-cc385c06a16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-456421114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31513423-6d70-4042-af32-a367252e8681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe392be96afe46f59b7dbfe56755e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:44:23Z,use_quota=True,user_id='2ce001ff3d424e6098eebb43c1044d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f168f6d6-6615-4fe3-a22c-5bc926b950f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f168f6d6-6615-4fe3-a22c-5bc926b950f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d05209e-a93e-47e4-869c-ea6078f5023d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d05209e-a93e-47e4-869c-ea6078f5023d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31513423-6d70-4042-af32-a367252e8681', 'volume_name': 'volume-31513423-6d70-4042-af32-a367252e8681', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c30912a-bc94-4d08-b90c-0830a54c8084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c30912a-bc94-4d08-b90c-0830a54c8084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a90dce-810e-4623-be2a-4aed910b5107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:23 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Volume 31513423-6d70-4042-af32-a367252e8681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31513423-6d70-4042-af32-a367252e8681', 'volume_size': 1} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-456421114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31513423-6d70-4042-af32-a367252e8681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe392be96afe46f59b7dbfe56755e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:44:23Z,use_quota=True,user_id='2ce001ff3d424e6098eebb43c1044d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Creating volume 31513423-6d70-4042-af32-a367252e8681 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:44:23 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:44:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-31513423-6d70-4042-af32-a367252e8681 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:23 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-31513423-6d70-4042-af32-a367252e8681 1073741824 Jun 16 08:44:23 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:24 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-31513423-6d70-4042-af32-a367252e8681 1073741824" returned: 0 in 1.539s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-31513423-6d70-4042-af32-a367252e8681 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:25 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-31513423-6d70-4042-af32-a367252e8681 Jun 16 08:44:25 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:26 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-31513423-6d70-4042-af32-a367252e8681" returned: 0 in 1.817s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] <== create_volume: return (3462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:44:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.467s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a90dce-810e-4623-be2a-4aed910b5107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31513423-6d70-4042-af32-a367252e8681', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e7f2f8-2fe7-4837-a4f9-d6f2c61d6936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:26 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Volume volume-31513423-6d70-4042-af32-a367252e8681 (31513423-6d70-4042-af32-a367252e8681): created successfully Jun 16 08:44:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e7f2f8-2fe7-4837-a4f9-d6f2c61d6936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Flow 'volume_create_manager' (fef94dbe-35b8-4468-83c6-17a5b584e7ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:44:27 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-0303160d-46de-4d4c-8db9-adf69849d8e6 tempest-VolumesActionsTest-2106806861 None] Created volume successfully. Jun 16 08:44:27 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:44:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Flow 'volume_create_manager' (206480c6-4448-4d2c-9d9f-ee0409e4c855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:44:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a1f284-6e60-4198-a9d6-f64427cef3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a1f284-6e60-4198-a9d6-f64427cef3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-272798744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55347fa8-16be-4824-a869-cdfebfe59f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bcf55b96e3b4e42b5b514d989953163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:44:28Z,use_quota=True,user_id='32f1f6c80b7c4e54a524e4dcc2a0a47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397aaf29-fafe-46f5-8b11-4e1f9d2ee2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397aaf29-fafe-46f5-8b11-4e1f9d2ee2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91cbfe64-8cd5-4d77-91c2-c8422f1e15f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91cbfe64-8cd5-4d77-91c2-c8422f1e15f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55347fa8-16be-4824-a869-cdfebfe59f55', 'volume_name': 'volume-55347fa8-16be-4824-a869-cdfebfe59f55', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a99feb2-0847-45a4-b971-df228036ed8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a99feb2-0847-45a4-b971-df228036ed8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b09604-5ac7-4f28-9442-0014661cd309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:28 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Volume 55347fa8-16be-4824-a869-cdfebfe59f55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55347fa8-16be-4824-a869-cdfebfe59f55', 'volume_size': 1} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-272798744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55347fa8-16be-4824-a869-cdfebfe59f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bcf55b96e3b4e42b5b514d989953163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:44:28Z,use_quota=True,user_id='32f1f6c80b7c4e54a524e4dcc2a0a47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Creating volume 55347fa8-16be-4824-a869-cdfebfe59f55 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:44:28 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:28 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 1073741824 Jun 16 08:44:28 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ba7f71ce-798b-4547-bc15-c43b59ab8a37 tempest-VolumesActionsTest-2106806861 None] Acquiring lock "cinder-31513423-6d70-4042-af32-a367252e8681" by "attach_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ba7f71ce-798b-4547-bc15-c43b59ab8a37 tempest-VolumesActionsTest-2106806861 None] Lock "cinder-31513423-6d70-4042-af32-a367252e8681" acquired by "attach_volume" :: waited 0.061s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:44:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ba7f71ce-798b-4547-bc15-c43b59ab8a37 tempest-VolumesActionsTest-2106806861 None] Attaching volume 31513423-6d70-4042-af32-a367252e8681 to instance c0ec530b-e5a0-4a23-9dca-1de3ac27e7c2 at mountpoint /dev/vdb on host None. Jun 16 08:44:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ba7f71ce-798b-4547-bc15-c43b59ab8a37 tempest-VolumesActionsTest-2106806861 None] Attach volume completed successfully. Jun 16 08:44:28 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ba7f71ce-798b-4547-bc15-c43b59ab8a37 tempest-VolumesActionsTest-2106806861 None] Lock "cinder-31513423-6d70-4042-af32-a367252e8681" released by "attach_volume" :: held 0.191s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:44:29 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 1073741824" returned: 0 in 1.103s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:29 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 Jun 16 08:44:29 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:29 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-88ab8e6e-6823-4106-88ab-262a0f8378f7 tempest-VolumesActionsTest-805572971 None] Terminate volume connection completed successfully. Jun 16 08:44:30 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55" returned: 0 in 0.830s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b09604-5ac7-4f28-9442-0014661cd309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55347fa8-16be-4824-a869-cdfebfe59f55', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a408dd0-2ad7-4fbd-a756-3d5b3291d267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:30 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Volume volume-55347fa8-16be-4824-a869-cdfebfe59f55 (55347fa8-16be-4824-a869-cdfebfe59f55): created successfully Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a408dd0-2ad7-4fbd-a756-3d5b3291d267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Flow 'volume_create_manager' (206480c6-4448-4d2c-9d9f-ee0409e4c855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:44:30 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-a8cf75ef-9ca4-48f1-bc3e-4ea1c60e73b1 tempest-VolumesActionsTest-781391049 None] Created volume successfully. Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-88ab8e6e-6823-4106-88ab-262a0f8378f7 tempest-VolumesActionsTest-805572971 None] Acquiring lock "cinder-31513423-6d70-4042-af32-a367252e8681-detach_volume" by "detach_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:44:30 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:44:30 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-88ab8e6e-6823-4106-88ab-262a0f8378f7 tempest-VolumesActionsTest-805572971 None] Lock "cinder-31513423-6d70-4042-af32-a367252e8681-detach_volume" acquired by "detach_volume" :: waited 0.055s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:44:30 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-88ab8e6e-6823-4106-88ab-262a0f8378f7 tempest-VolumesActionsTest-805572971 None] Detaching volume 31513423-6d70-4042-af32-a367252e8681 from instance c0ec530b-e5a0-4a23-9dca-1de3ac27e7c2. Jun 16 08:44:30 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-88ab8e6e-6823-4106-88ab-262a0f8378f7 tempest-VolumesActionsTest-805572971 None] Detach volume completed successfully. Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-88ab8e6e-6823-4106-88ab-262a0f8378f7 tempest-VolumesActionsTest-805572971 None] Lock "cinder-31513423-6d70-4042-af32-a367252e8681-detach_volume" released by "detach_volume" :: held 0.243s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-14ef1f55-19bd-4c72-bf9e-54a6144f5726 tempest-VolumesActionsTest-2106806861 None] Acquiring lock "cinder-31513423-6d70-4042-af32-a367252e8681-detach_volume" by "detach_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-14ef1f55-19bd-4c72-bf9e-54a6144f5726 tempest-VolumesActionsTest-2106806861 None] Lock "cinder-31513423-6d70-4042-af32-a367252e8681-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:44:30 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-14ef1f55-19bd-4c72-bf9e-54a6144f5726 tempest-VolumesActionsTest-2106806861 None] Volume detach called, but volume not attached. Jun 16 08:44:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-14ef1f55-19bd-4c72-bf9e-54a6144f5726 tempest-VolumesActionsTest-2106806861 None] Lock "cinder-31513423-6d70-4042-af32-a367252e8681-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:44:31 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.932s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:31 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:44:31 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:44:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 8 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:44:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:44:31 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] Acquiring lock "cinder-31513423-6d70-4042-af32-a367252e8681-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:44:31 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] Lock "cinder-31513423-6d70-4042-af32-a367252e8681-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:44:31 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] Acquiring lock "cinder-quobyte-31513423-6d70-4042-af32-a367252e8681" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:44:31 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] Lock "cinder-quobyte-31513423-6d70-4042-af32-a367252e8681" acquired by "delete_volume" :: waited 0.055s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:44:31 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec4dd83-80d5-48a2-8c03-4cbebb779e68]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:44:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-31513423-6d70-4042-af32-a367252e8681 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:32 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-31513423-6d70-4042-af32-a367252e8681 Jun 16 08:44:32 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:33 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-31513423-6d70-4042-af32-a367252e8681" returned: 0 in 1.153s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-31513423-6d70-4042-af32-a367252e8681 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:33 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-31513423-6d70-4042-af32-a367252e8681 Jun 16 08:44:33 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:33 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-31513423-6d70-4042-af32-a367252e8681" returned: 0 in 0.715s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:33 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] Lock "cinder-quobyte-31513423-6d70-4042-af32-a367252e8681" released by "delete_volume" :: held 1.933s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:44:33 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] Created reservations ['fdcac6f1-0476-4a01-8e43-13b50fe3bb4e', '4c03cad1-386d-4c6b-a0d6-21caaa1be1f0', 'e809ecb1-6a69-4573-8196-3d2c2dcf2565', 'b37c2a1c-a457-4b87-9c76-98f1c94ce405'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:44:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:44:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:44:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:33 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:44:33 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:34 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.892s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:34 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:44:34 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] Deleted volume successfully. Jun 16 08:44:34 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-08ca5a3c-ae65-421f-ae4e-69102e16aba4 tempest-VolumesActionsTest-2106806861 None] Lock "cinder-31513423-6d70-4042-af32-a367252e8681-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Flow 'volume_create_manager' (baef42f1-d9b6-4db1-83ba-b2abf05ea5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f602ee7b-3f93-4fd7-a798-aae4bd41488b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f602ee7b-3f93-4fd7-a798-aae4bd41488b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-754722474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe392be96afe46f59b7dbfe56755e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:44:42Z,use_quota=True,user_id='2ce001ff3d424e6098eebb43c1044d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362b0b22-0250-4495-8fe9-be849648cc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362b0b22-0250-4495-8fe9-be849648cc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b336bf-b397-4a30-8b76-eec9eaaba3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b336bf-b397-4a30-8b76-eec9eaaba3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7', 'volume_name': 'volume-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36058c79-e972-4986-a07b-8de2790261d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36058c79-e972-4986-a07b-8de2790261d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a2bb86-e25c-4566-a986-5c68df90fd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:41 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Volume fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7', 'volume_size': 1} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-754722474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe392be96afe46f59b7dbfe56755e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:44:42Z,use_quota=True,user_id='2ce001ff3d424e6098eebb43c1044d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Creating volume fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:44:41 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:44:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:41 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7 1073741824 Jun 16 08:44:41 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:42 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7 1073741824" returned: 0 in 0.740s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:42 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7 Jun 16 08:44:42 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:43 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7" returned: 0 in 0.609s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:44:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a2bb86-e25c-4566-a986-5c68df90fd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e94f28-1f2a-47e0-b000-8f7b4d07faca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:43 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Volume volume-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7 (fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7): created successfully Jun 16 08:44:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e94f28-1f2a-47e0-b000-8f7b4d07faca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Flow 'volume_create_manager' (baef42f1-d9b6-4db1-83ba-b2abf05ea5eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:44:43 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4faaae44-5c18-407a-9eb6-c3e37ed07339 tempest-VolumesActionsTest-2106806861 None] Created volume successfully. Jun 16 08:44:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] Acquiring lock "cinder-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:44:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] Lock "cinder-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:44:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] Acquiring lock "cinder-quobyte-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:44:44 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] Lock "cinder-quobyte-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7" acquired by "delete_volume" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:44:44 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[76675972-8f57-4e50-b20a-a9121e14e424]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:44:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:44 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7 Jun 16 08:44:44 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:44 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7" returned: 0 in 0.709s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:44 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7 Jun 16 08:44:44 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:45 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7" returned: 0 in 1.038s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:45 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] Lock "cinder-quobyte-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7" released by "delete_volume" :: held 1.788s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:44:45 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] Created reservations ['63a6b6db-c0c0-4679-9ae9-b5aaec2d7e56', '01b166f9-1170-4150-8f63-56c6b719a03d', 'ed27ed6a-6e5d-42f6-93c8-a6d20c97d80a', '1a8eaf1d-e325-408a-9bf7-b490e1611b61'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:44:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:45 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:44:45 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:44:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:45 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:44:45 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:46 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.617s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:44:46 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] Deleted volume successfully. Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f1e3a5e9-2a20-42e3-8aac-002c34fbce3e tempest-VolumesActionsTest-805572971 None] Lock "cinder-fa4130b7-f6e7-4cfd-abb1-5b761e1e3cb7-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Flow 'volume_create_manager' (c1eb5a39-675a-4686-b537-5b22beb56179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049a0711-995f-49dc-9e27-60337a5421c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049a0711-995f-49dc-9e27-60337a5421c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-403932997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a98ac1-2cc1-404a-8906-c577a3a76332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe392be96afe46f59b7dbfe56755e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:44:47Z,use_quota=True,user_id='2ce001ff3d424e6098eebb43c1044d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15906db4-fae2-4539-9aa5-37be4b8483ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15906db4-fae2-4539-9aa5-37be4b8483ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc092f7-744d-45cb-ba07-f5d1027c38af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc092f7-744d-45cb-ba07-f5d1027c38af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5a98ac1-2cc1-404a-8906-c577a3a76332', 'volume_name': 'volume-c5a98ac1-2cc1-404a-8906-c577a3a76332', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54cdf4f4-aa6a-40a0-a632-ad1055bd0275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54cdf4f4-aa6a-40a0-a632-ad1055bd0275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749857fc-0c78-4c9b-b1d2-6721efb288e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:46 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Volume c5a98ac1-2cc1-404a-8906-c577a3a76332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5a98ac1-2cc1-404a-8906-c577a3a76332', 'volume_size': 1} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-403932997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a98ac1-2cc1-404a-8906-c577a3a76332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe392be96afe46f59b7dbfe56755e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:44:47Z,use_quota=True,user_id='2ce001ff3d424e6098eebb43c1044d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Creating volume c5a98ac1-2cc1-404a-8906-c577a3a76332 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:44:46 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:44:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c5a98ac1-2cc1-404a-8906-c577a3a76332 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:46 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c5a98ac1-2cc1-404a-8906-c577a3a76332 1073741824 Jun 16 08:44:46 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:47 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c5a98ac1-2cc1-404a-8906-c577a3a76332 1073741824" returned: 0 in 0.858s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c5a98ac1-2cc1-404a-8906-c577a3a76332 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:47 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c5a98ac1-2cc1-404a-8906-c577a3a76332 Jun 16 08:44:47 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6d67279c-99ce-4704-894b-672180abf28f tempest-VolumesActionsTest-781391049 None] Acquiring lock "cinder-55347fa8-16be-4824-a869-cdfebfe59f55" by "attach_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:44:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6d67279c-99ce-4704-894b-672180abf28f tempest-VolumesActionsTest-781391049 None] Lock "cinder-55347fa8-16be-4824-a869-cdfebfe59f55" acquired by "attach_volume" :: waited 0.034s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:44:48 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c5a98ac1-2cc1-404a-8906-c577a3a76332" returned: 0 in 0.647s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:44:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749857fc-0c78-4c9b-b1d2-6721efb288e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5a98ac1-2cc1-404a-8906-c577a3a76332', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1d601b-f431-4139-ad83-5df7006df37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:48 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-6d67279c-99ce-4704-894b-672180abf28f tempest-VolumesActionsTest-781391049 None] Attaching volume 55347fa8-16be-4824-a869-cdfebfe59f55 to instance 2db64fb5-d4ce-4f56-9826-afc0458105f2 at mountpoint /dev/vdb on host None. Jun 16 08:44:48 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Volume volume-c5a98ac1-2cc1-404a-8906-c577a3a76332 (c5a98ac1-2cc1-404a-8906-c577a3a76332): created successfully Jun 16 08:44:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1d601b-f431-4139-ad83-5df7006df37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Flow 'volume_create_manager' (c1eb5a39-675a-4686-b537-5b22beb56179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:44:48 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-6d67279c-99ce-4704-894b-672180abf28f tempest-VolumesActionsTest-781391049 None] Attach volume completed successfully. Jun 16 08:44:48 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-dbe39b90-40c1-4fe0-b87c-a1fe63ef530b tempest-VolumesActionsTest-2106806861 None] Created volume successfully. Jun 16 08:44:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6d67279c-99ce-4704-894b-672180abf28f tempest-VolumesActionsTest-781391049 None] Lock "cinder-55347fa8-16be-4824-a869-cdfebfe59f55" released by "attach_volume" :: held 0.133s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:44:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-76ee7999-512b-4788-8766-ade8799b9eac tempest-VolumesActionsTest-781391049 None] Acquiring lock "cinder-55347fa8-16be-4824-a869-cdfebfe59f55-detach_volume" by "detach_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:44:49 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] Acquiring lock "cinder-c5a98ac1-2cc1-404a-8906-c577a3a76332-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:44:49 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-76ee7999-512b-4788-8766-ade8799b9eac tempest-VolumesActionsTest-781391049 None] Lock "cinder-55347fa8-16be-4824-a869-cdfebfe59f55-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:44:49 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-76ee7999-512b-4788-8766-ade8799b9eac tempest-VolumesActionsTest-781391049 None] Detaching volume 55347fa8-16be-4824-a869-cdfebfe59f55 from instance 2db64fb5-d4ce-4f56-9826-afc0458105f2. Jun 16 08:44:49 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] Lock "cinder-c5a98ac1-2cc1-404a-8906-c577a3a76332-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:44:49 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] Acquiring lock "cinder-quobyte-c5a98ac1-2cc1-404a-8906-c577a3a76332" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:44:49 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-76ee7999-512b-4788-8766-ade8799b9eac tempest-VolumesActionsTest-781391049 None] Detach volume completed successfully. Jun 16 08:44:49 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] Lock "cinder-quobyte-c5a98ac1-2cc1-404a-8906-c577a3a76332" acquired by "delete_volume" :: waited 0.023s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:44:49 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-76ee7999-512b-4788-8766-ade8799b9eac tempest-VolumesActionsTest-781391049 None] Lock "cinder-55347fa8-16be-4824-a869-cdfebfe59f55-detach_volume" released by "detach_volume" :: held 0.178s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:44:49 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1932e0c-0cd4-41a7-9623-acaf1dd53fe3]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:44:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c5a98ac1-2cc1-404a-8906-c577a3a76332 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:49 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c5a98ac1-2cc1-404a-8906-c577a3a76332 Jun 16 08:44:49 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:50 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c5a98ac1-2cc1-404a-8906-c577a3a76332" returned: 0 in 1.021s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c5a98ac1-2cc1-404a-8906-c577a3a76332 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:50 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c5a98ac1-2cc1-404a-8906-c577a3a76332 Jun 16 08:44:50 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:51 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c5a98ac1-2cc1-404a-8906-c577a3a76332" returned: 0 in 1.119s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:51 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] Lock "cinder-quobyte-c5a98ac1-2cc1-404a-8906-c577a3a76332" released by "delete_volume" :: held 2.214s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:44:51 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=70,cinder:UPDATE=62,cinder:INSERT=12,cinder:DELETE=3 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:44:51 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] Created reservations ['20e1f6a9-be7a-4418-a4df-9f48aea4de2b', '5844c1e4-c23b-4580-ae1d-a665f21c3ada', '23973849-4463-4bf5-bf90-b8c3dd358dc8', '7f5b9377-0db4-44a0-874b-2d26709605bc'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:44:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:44:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:44:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:51 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:44:51 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:52 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-10a370c2-c0c1-4794-876f-be79abb47575 req-5ada631a-55d0-42e1-a898-fed08023189a tempest-AttachVolumeShelveTestJSON-502799397 None] Terminate volume connection completed successfully. Jun 16 08:44:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-10a370c2-c0c1-4794-876f-be79abb47575 req-5ada631a-55d0-42e1-a898-fed08023189a tempest-AttachVolumeShelveTestJSON-502799397 None] Deleting attachment 349aa0fe-f82c-4837-94ea-1b1d8cbd9fcc. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:44:52 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.736s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:52 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:44:52 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] Deleted volume successfully. Jun 16 08:44:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8098df9f-7505-4551-8cb9-5b62fda50d9f tempest-VolumesActionsTest-805572971 None] Lock "cinder-c5a98ac1-2cc1-404a-8906-c577a3a76332-delete_volume" released by "delete_volume" :: held 3.337s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:44:52 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=68,cinder:UPDATE=72,cinder:INSERT=18,cinder:DELETE=7 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:44:52 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Flow 'volume_create_manager' (a1aba8c5-90fe-4514-b022-a69dda0c2d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb88943-f012-4b84-ae82-0d65aed5f5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb88943-f012-4b84-ae82-0d65aed5f5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1674726991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea136ff-0abc-43ff-90f0-9406402539c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe392be96afe46f59b7dbfe56755e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:44:53Z,use_quota=True,user_id='2ce001ff3d424e6098eebb43c1044d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d539068d-0055-47c6-9a24-e136d88542d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d539068d-0055-47c6-9a24-e136d88542d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe3fcf4-4c3d-49fc-8f1b-367a9abf9a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe3fcf4-4c3d-49fc-8f1b-367a9abf9a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ea136ff-0abc-43ff-90f0-9406402539c0', 'volume_name': 'volume-9ea136ff-0abc-43ff-90f0-9406402539c0', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1803b48-d474-4848-90ed-c9421506a244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1803b48-d474-4848-90ed-c9421506a244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0ff5f5-008a-4070-a05c-83645bbcc91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:53 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Volume 9ea136ff-0abc-43ff-90f0-9406402539c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ea136ff-0abc-43ff-90f0-9406402539c0', 'volume_size': 1} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1674726991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea136ff-0abc-43ff-90f0-9406402539c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe392be96afe46f59b7dbfe56755e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:44:53Z,use_quota=True,user_id='2ce001ff3d424e6098eebb43c1044d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Creating volume 9ea136ff-0abc-43ff-90f0-9406402539c0 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:44:53 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9ea136ff-0abc-43ff-90f0-9406402539c0 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:53 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9ea136ff-0abc-43ff-90f0-9406402539c0 1073741824 Jun 16 08:44:53 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:53 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9ea136ff-0abc-43ff-90f0-9406402539c0 1073741824" returned: 0 in 0.841s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9ea136ff-0abc-43ff-90f0-9406402539c0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:53 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9ea136ff-0abc-43ff-90f0-9406402539c0 Jun 16 08:44:53 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:54 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9ea136ff-0abc-43ff-90f0-9406402539c0" returned: 0 in 0.624s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:44:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0ff5f5-008a-4070-a05c-83645bbcc91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ea136ff-0abc-43ff-90f0-9406402539c0', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62097c4-50c0-4686-ad50-668e88cdc4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:54 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Volume volume-9ea136ff-0abc-43ff-90f0-9406402539c0 (9ea136ff-0abc-43ff-90f0-9406402539c0): created successfully Jun 16 08:44:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62097c4-50c0-4686-ad50-668e88cdc4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Flow 'volume_create_manager' (a1aba8c5-90fe-4514-b022-a69dda0c2d64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:44:54 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-d3222b0a-19e6-4ca7-a275-6374741fdfac tempest-VolumesActionsTest-2106806861 None] Created volume successfully. Jun 16 08:44:55 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-3791d5fe-6967-4639-b5a9-787d21aeb6fd req-85b6cb03-b524-4475-a1be-ab135099dd86 tempest-ServerActionsTestOtherA-233125094 None] Terminate volume connection completed successfully. Jun 16 08:44:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-3791d5fe-6967-4639-b5a9-787d21aeb6fd req-85b6cb03-b524-4475-a1be-ab135099dd86 tempest-ServerActionsTestOtherA-233125094 None] Deleting attachment b7a3b5c5-b67d-4dd5-95da-1503910487ed. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:44:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] Acquiring lock "cinder-9ea136ff-0abc-43ff-90f0-9406402539c0-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:44:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] Lock "cinder-9ea136ff-0abc-43ff-90f0-9406402539c0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:44:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] Acquiring lock "cinder-quobyte-9ea136ff-0abc-43ff-90f0-9406402539c0" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:44:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] Lock "cinder-quobyte-9ea136ff-0abc-43ff-90f0-9406402539c0" acquired by "delete_volume" :: waited 0.036s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:44:55 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[456b2989-e992-4d4e-928e-4ff83a000d9b]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:44:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9ea136ff-0abc-43ff-90f0-9406402539c0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:55 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9ea136ff-0abc-43ff-90f0-9406402539c0 Jun 16 08:44:55 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:56 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9ea136ff-0abc-43ff-90f0-9406402539c0" returned: 0 in 1.065s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9ea136ff-0abc-43ff-90f0-9406402539c0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:56 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9ea136ff-0abc-43ff-90f0-9406402539c0 Jun 16 08:44:56 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:57 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9ea136ff-0abc-43ff-90f0-9406402539c0" returned: 0 in 0.702s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] Lock "cinder-quobyte-9ea136ff-0abc-43ff-90f0-9406402539c0" released by "delete_volume" :: held 1.858s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:44:57 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] Created reservations ['217ba073-d78f-4571-ba5a-b4130c592d2b', '56b10374-0420-4680-9a5a-aea9315fe0cb', '87ab6142-4681-4aa3-a9b2-fc83e6559e4a', '7626ad9d-62a0-42c9-948f-8b4736146feb'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:44:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:44:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:44:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:57 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:44:57 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Flow 'volume_create_manager' (18122556-f84a-49be-9621-7fc1336759c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10bc9c59-ebbd-41e2-b877-2ac0898144c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10bc9c59-ebbd-41e2-b877-2ac0898144c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-283137505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe392be96afe46f59b7dbfe56755e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:44:58Z,use_quota=True,user_id='2ce001ff3d424e6098eebb43c1044d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d3c276-f7cb-4f65-a56c-1e839df1fdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d3c276-f7cb-4f65-a56c-1e839df1fdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ab0a9b-074c-4071-89ad-8a9616d7dc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ab0a9b-074c-4071-89ad-8a9616d7dc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4', 'volume_name': 'volume-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d21d25-e982-4160-a341-17e47b6227d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d21d25-e982-4160-a341-17e47b6227d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59ac929-b058-4e85-95ef-65e9cb19023b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:44:58 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Volume cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4', 'volume_size': 1} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-283137505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe392be96afe46f59b7dbfe56755e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:44:58Z,use_quota=True,user_id='2ce001ff3d424e6098eebb43c1044d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Creating volume cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:44:58 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:58 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4 1073741824 Jun 16 08:44:58 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:44:58 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.901s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:44:58 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] Deleted volume successfully. Jun 16 08:44:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2c1f7cfb-e3eb-4ff2-ac13-6f758c425aff tempest-VolumesActionsTest-805572971 None] Lock "cinder-9ea136ff-0abc-43ff-90f0-9406402539c0-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:44:59 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jun 16 08:44:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4 1073741824" returned: 0 in 1.062s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:44:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:44:59 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4 Jun 16 08:44:59 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:00 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4" returned: 0 in 0.680s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:45:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:45:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59ac929-b058-4e85-95ef-65e9cb19023b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9887aa-0298-4bb2-b751-df621b5cf682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:00 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Volume volume-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4 (cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4): created successfully Jun 16 08:45:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9887aa-0298-4bb2-b751-df621b5cf682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Flow 'volume_create_manager' (18122556-f84a-49be-9621-7fc1336759c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:45:00 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-fe12d483-3a4a-476c-abb3-601343423242 tempest-VolumesActionsTest-2106806861 None] Created volume successfully. Jun 16 08:45:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] Acquiring lock "cinder-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:45:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] Lock "cinder-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:45:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] Acquiring lock "cinder-quobyte-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:45:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] Lock "cinder-quobyte-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4" acquired by "delete_volume" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:45:00 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a585578b-a3a3-4a1a-96c6-249311f3a1c1]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:45:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:00 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4 Jun 16 08:45:00 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:01 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4" returned: 0 in 0.851s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:01 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4 Jun 16 08:45:01 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:02 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4" returned: 0 in 0.607s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] Lock "cinder-quobyte-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4" released by "delete_volume" :: held 1.505s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:45:02 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] Created reservations ['c66e4744-06fb-498e-8a23-d57f9f5ac432', 'c4e5726d-52b8-4e50-bd9f-0e522dd76d3a', '2888a490-3d89-413b-839f-47bc5b6b0783', '3dd4771a-65ae-45dd-b6e3-21f4263b482d'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:45:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:45:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:45:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:45:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:45:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:45:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:02 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:45:02 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:03 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.624s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:45:03 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] Deleted volume successfully. Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-88e63fb4-3725-4e86-ac25-809100e70dc4 tempest-VolumesActionsTest-805572971 None] Lock "cinder-cc89dbc1-1727-4868-b1bf-dc0cf8bc62d4-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Flow 'volume_create_manager' (2f7b4148-9f2c-4184-9358-5162868e57de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5efa413e-152c-4637-baaf-4a4520bd00a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5efa413e-152c-4637-baaf-4a4520bd00a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1660796812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8648234f-fbbb-4726-9395-b9d8859079db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe392be96afe46f59b7dbfe56755e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:45:03Z,use_quota=True,user_id='2ce001ff3d424e6098eebb43c1044d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1c87a8-a4da-4d0c-8991-2c41a1897bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1c87a8-a4da-4d0c-8991-2c41a1897bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c792521-b8d5-4aa9-b134-285d6a32def3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c792521-b8d5-4aa9-b134-285d6a32def3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8648234f-fbbb-4726-9395-b9d8859079db', 'volume_name': 'volume-8648234f-fbbb-4726-9395-b9d8859079db', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d67dbd-29a0-4e3a-bc3d-88d25a26cd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d67dbd-29a0-4e3a-bc3d-88d25a26cd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b75f03e-6028-4b0d-a521-f500fbaf8215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:03 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Volume 8648234f-fbbb-4726-9395-b9d8859079db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8648234f-fbbb-4726-9395-b9d8859079db', 'volume_size': 1} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1660796812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8648234f-fbbb-4726-9395-b9d8859079db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe392be96afe46f59b7dbfe56755e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:45:03Z,use_quota=True,user_id='2ce001ff3d424e6098eebb43c1044d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Creating volume 8648234f-fbbb-4726-9395-b9d8859079db {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:45:03 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:45:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8648234f-fbbb-4726-9395-b9d8859079db 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:03 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8648234f-fbbb-4726-9395-b9d8859079db 1073741824 Jun 16 08:45:03 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:04 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8648234f-fbbb-4726-9395-b9d8859079db 1073741824" returned: 0 in 1.057s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8648234f-fbbb-4726-9395-b9d8859079db {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:04 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8648234f-fbbb-4726-9395-b9d8859079db Jun 16 08:45:04 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8648234f-fbbb-4726-9395-b9d8859079db" returned: 0 in 0.670s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:45:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:45:05 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b75f03e-6028-4b0d-a521-f500fbaf8215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8648234f-fbbb-4726-9395-b9d8859079db', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f998957-0432-44ec-a420-21369d1aa023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:05 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Volume volume-8648234f-fbbb-4726-9395-b9d8859079db (8648234f-fbbb-4726-9395-b9d8859079db): created successfully Jun 16 08:45:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f998957-0432-44ec-a420-21369d1aa023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Flow 'volume_create_manager' (2f7b4148-9f2c-4184-9358-5162868e57de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:45:05 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-619ee3ce-d335-4e77-a2be-e38da1eec055 tempest-VolumesActionsTest-2106806861 None] Created volume successfully. Jun 16 08:45:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] Acquiring lock "cinder-8648234f-fbbb-4726-9395-b9d8859079db-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:45:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] Lock "cinder-8648234f-fbbb-4726-9395-b9d8859079db-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:45:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] Acquiring lock "cinder-quobyte-8648234f-fbbb-4726-9395-b9d8859079db" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:45:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] Lock "cinder-quobyte-8648234f-fbbb-4726-9395-b9d8859079db" acquired by "delete_volume" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:45:06 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2da97f2-376a-4792-a114-626d1bc6b560]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:45:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8648234f-fbbb-4726-9395-b9d8859079db {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:06 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8648234f-fbbb-4726-9395-b9d8859079db Jun 16 08:45:06 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] Acquiring lock "cinder-ce398028-b899-4ea6-a1d2-d4f9b30e25a7-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:45:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] Lock "cinder-ce398028-b899-4ea6-a1d2-d4f9b30e25a7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:45:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] Acquiring lock "cinder-quobyte-ce398028-b899-4ea6-a1d2-d4f9b30e25a7" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:45:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] Lock "cinder-quobyte-ce398028-b899-4ea6-a1d2-d4f9b30e25a7" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:45:07 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9be237-1946-4707-8f62-0c767aeb20da]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:45:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:07 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7 Jun 16 08:45:07 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:07 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8648234f-fbbb-4726-9395-b9d8859079db" returned: 0 in 0.861s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8648234f-fbbb-4726-9395-b9d8859079db {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:07 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8648234f-fbbb-4726-9395-b9d8859079db Jun 16 08:45:07 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:07 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7" returned: 0 in 0.797s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:07 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7 Jun 16 08:45:07 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:08 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8648234f-fbbb-4726-9395-b9d8859079db" returned: 0 in 0.643s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] Lock "cinder-quobyte-8648234f-fbbb-4726-9395-b9d8859079db" released by "delete_volume" :: held 1.557s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] Created reservations ['0f55b235-853e-4a4a-913b-f11f3d52811d', 'f0e8a517-49d7-4621-b42d-3e4be25bdfaa', '152ec57f-5dc0-4348-bc42-025d35454dff', '59f9384d-df62-425c-9488-9d3042d718ab'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:08 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:45:08 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:08 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ce398028-b899-4ea6-a1d2-d4f9b30e25a7" returned: 0 in 0.610s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] Lock "cinder-quobyte-ce398028-b899-4ea6-a1d2-d4f9b30e25a7" released by "delete_volume" :: held 1.468s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] Created reservations ['f601dd6d-aa3d-4a17-aa11-2ac41513e557', '905bff4e-b0be-4998-a2fb-daba612ef9df', '8c57b469-5906-4eb7-b4d3-096e04232adc', '7f73e3f2-e5b4-4832-9b89-72dfbc152d17'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:45:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:08 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:45:08 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:09 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.650s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:09 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:45:09 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] Deleted volume successfully. Jun 16 08:45:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2276c8cb-0fa2-4485-85d3-b1aaf48e2bd7 tempest-VolumesActionsTest-2106806861 None] Lock "cinder-8648234f-fbbb-4726-9395-b9d8859079db-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:45:09 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.650s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:09 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:45:09 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] Deleted volume successfully. Jun 16 08:45:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bf326237-68e9-4517-84fb-a7590b96151a tempest-ServerActionsTestOtherA-233125094 None] Lock "cinder-ce398028-b899-4ea6-a1d2-d4f9b30e25a7-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:45:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ef2e62e8-b776-4d27-9fc3-cdd33632af6b tempest-VolumesActionsTest-781391049 None] Acquiring lock "cinder-55347fa8-16be-4824-a869-cdfebfe59f55" by "attach_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:45:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ef2e62e8-b776-4d27-9fc3-cdd33632af6b tempest-VolumesActionsTest-781391049 None] Lock "cinder-55347fa8-16be-4824-a869-cdfebfe59f55" acquired by "attach_volume" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:45:15 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ef2e62e8-b776-4d27-9fc3-cdd33632af6b tempest-VolumesActionsTest-781391049 None] Attaching volume 55347fa8-16be-4824-a869-cdfebfe59f55 to instance 2af6a913-3cd7-44cb-90ca-efb6fa3f6e61 at mountpoint /dev/vdb on host None. Jun 16 08:45:15 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ef2e62e8-b776-4d27-9fc3-cdd33632af6b tempest-VolumesActionsTest-781391049 None] Attach volume completed successfully. Jun 16 08:45:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ef2e62e8-b776-4d27-9fc3-cdd33632af6b tempest-VolumesActionsTest-781391049 None] Lock "cinder-55347fa8-16be-4824-a869-cdfebfe59f55" released by "attach_volume" :: held 0.109s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:45:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-25f6b36e-37db-4ee0-a97f-875f1ae2aed8 tempest-VolumesActionsTest-781391049 None] Acquiring lock "cinder-55347fa8-16be-4824-a869-cdfebfe59f55-detach_volume" by "detach_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:45:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-25f6b36e-37db-4ee0-a97f-875f1ae2aed8 tempest-VolumesActionsTest-781391049 None] Lock "cinder-55347fa8-16be-4824-a869-cdfebfe59f55-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:45:16 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-25f6b36e-37db-4ee0-a97f-875f1ae2aed8 tempest-VolumesActionsTest-781391049 None] Detaching volume 55347fa8-16be-4824-a869-cdfebfe59f55 from instance 2af6a913-3cd7-44cb-90ca-efb6fa3f6e61. Jun 16 08:45:16 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-25f6b36e-37db-4ee0-a97f-875f1ae2aed8 tempest-VolumesActionsTest-781391049 None] Detach volume completed successfully. Jun 16 08:45:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-25f6b36e-37db-4ee0-a97f-875f1ae2aed8 tempest-VolumesActionsTest-781391049 None] Lock "cinder-55347fa8-16be-4824-a869-cdfebfe59f55-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:45:26 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=30,cinder:INSERT=12,cinder:UPDATE=47,cinder:DELETE=2 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:45:26 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:UPDATE=46,cinder:SELECT=40,cinder:DELETE=6,cinder:INSERT=9 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Flow 'volume_create_manager' (b8e02fd6-60db-4d00-8bda-cfdbe09db978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3776cb3-b7f6-43f6-9726-3659d46c5559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3776cb3-b7f6-43f6-9726-3659d46c5559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-655571402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c34880e-ac40-4654-a307-dc90a47979be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e6b4222c254b689962d1ef29645f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:45:27Z,use_quota=True,user_id='9e40466e519441e6bcc592ca9a04478b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9938209d-52d3-4310-92d0-f425ff36e19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9938209d-52d3-4310-92d0-f425ff36e19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65180f9-38d4-43f5-a79a-6cb40d930122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65180f9-38d4-43f5-a79a-6cb40d930122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c34880e-ac40-4654-a307-dc90a47979be', 'volume_name': 'volume-1c34880e-ac40-4654-a307-dc90a47979be', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2b893b-8ec3-418d-9104-ecdbee2be141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2b893b-8ec3-418d-9104-ecdbee2be141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217a11f6-d5b1-422e-8bd6-aababf464f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:27 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Volume 1c34880e-ac40-4654-a307-dc90a47979be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c34880e-ac40-4654-a307-dc90a47979be', 'volume_size': 1} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-655571402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c34880e-ac40-4654-a307-dc90a47979be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e6b4222c254b689962d1ef29645f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:45:27Z,use_quota=True,user_id='9e40466e519441e6bcc592ca9a04478b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Creating volume 1c34880e-ac40-4654-a307-dc90a47979be {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:45:27 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:45:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1c34880e-ac40-4654-a307-dc90a47979be 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:27 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1c34880e-ac40-4654-a307-dc90a47979be 1073741824 Jun 16 08:45:27 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:28 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1c34880e-ac40-4654-a307-dc90a47979be 1073741824" returned: 0 in 0.996s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1c34880e-ac40-4654-a307-dc90a47979be {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:28 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1c34880e-ac40-4654-a307-dc90a47979be Jun 16 08:45:28 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2af2bebc-dc54-460e-a959-678f0a5b5904 tempest-VolumesActionsTest-781391049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:45:29 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1c34880e-ac40-4654-a307-dc90a47979be" returned: 0 in 0.718s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2af2bebc-dc54-460e-a959-678f0a5b5904 tempest-VolumesActionsTest-781391049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.630s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217a11f6-d5b1-422e-8bd6-aababf464f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c34880e-ac40-4654-a307-dc90a47979be', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29206e29-2dd8-46cf-acaa-20ee10c5e8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[277f879a-ad9b-43b9-92f2-5467645f80b8]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2af2bebc-dc54-460e-a959-678f0a5b5904 tempest-VolumesActionsTest-781391049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:29 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Volume volume-1c34880e-ac40-4654-a307-dc90a47979be (1c34880e-ac40-4654-a307-dc90a47979be): created successfully Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29206e29-2dd8-46cf-acaa-20ee10c5e8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Flow 'volume_create_manager' (b8e02fd6-60db-4d00-8bda-cfdbe09db978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:45:29 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-bfe79a51-42b7-4a43-bf57-63ed183ac1dd tempest-VolumesListAdminTestJSON-521308439 None] Created volume successfully. Jun 16 08:45:29 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 Jun 16 08:45:29 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Flow 'volume_create_manager' (68b44668-249b-4e1b-aef1-434e77421ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6cc106-ea01-4763-9f8b-2516d525d7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6cc106-ea01-4763-9f8b-2516d525d7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1328165506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebb5e16-94f2-4f68-bb83-859a8d4309d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ebf3624cf844ed80a717799cdc956c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:45:30Z,use_quota=True,user_id='999ada0f4f5d4ed1af00c597d24078cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287a4026-8ffe-45d8-8338-1231dd22447c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287a4026-8ffe-45d8-8338-1231dd22447c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da666295-483b-4039-9827-0fd105e1033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da666295-483b-4039-9827-0fd105e1033c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ebb5e16-94f2-4f68-bb83-859a8d4309d4', 'volume_name': 'volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a46585-e4ee-4b26-9f9e-7a26147fc34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a46585-e4ee-4b26-9f9e-7a26147fc34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a0cc2a-1396-4299-9b42-71dea0caee9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:29 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Volume 2ebb5e16-94f2-4f68-bb83-859a8d4309d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4', 'volume_size': 1} Jun 16 08:45:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:30 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:45:30 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Flow 'volume_create_manager' (e585ce58-1c3e-4110-a3cc-1ba9235dd232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808fdb5d-11a2-4ef4-b265-89cb5a604962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808fdb5d-11a2-4ef4-b265-89cb5a604962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1948044427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7816404-4781-463e-9078-c5f454bd0667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e6b4222c254b689962d1ef29645f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:45:30Z,use_quota=True,user_id='9e40466e519441e6bcc592ca9a04478b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787efb68-f582-4c16-abf6-d323330e0496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787efb68-f582-4c16-abf6-d323330e0496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f75971e-b760-4c44-87fa-04bd5dbea163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f75971e-b760-4c44-87fa-04bd5dbea163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7816404-4781-463e-9078-c5f454bd0667', 'volume_name': 'volume-a7816404-4781-463e-9078-c5f454bd0667', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb7d440-3aaa-40cd-8640-8137674b345c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb7d440-3aaa-40cd-8640-8137674b345c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f292e3fe-8046-409f-9f4e-abb83403f133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:30 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Volume a7816404-4781-463e-9078-c5f454bd0667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7816404-4781-463e-9078-c5f454bd0667', 'volume_size': 1} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:45:30 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2af2bebc-dc54-460e-a959-678f0a5b5904 tempest-VolumesActionsTest-781391049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55" returned: 0 in 1.309s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad0d28f-3a62-40df-b715-2d58c16a3dbc]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2af2bebc-dc54-460e-a959-678f0a5b5904 tempest-VolumesActionsTest-781391049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:30 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 Jun 16 08:45:30 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:30 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.809s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:30 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:45:31 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:45:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 8 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:45:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:45:31 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2af2bebc-dc54-460e-a959-678f0a5b5904 tempest-VolumesActionsTest-781391049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55" returned: 0 in 0.766s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2af2bebc-dc54-460e-a959-678f0a5b5904 tempest-VolumesActionsTest-781391049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.8d2c0a6e-17a7-42bd-b8da-c40ea09ba128fiu_cndc.img {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:31 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.8d2c0a6e-17a7-42bd-b8da-c40ea09ba128fiu_cndc.img Jun 16 08:45:31 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:37 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2af2bebc-dc54-460e-a959-678f0a5b5904 tempest-VolumesActionsTest-781391049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.8d2c0a6e-17a7-42bd-b8da-c40ea09ba128fiu_cndc.img" returned: 0 in 5.629s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:37 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53c22c8-2ffc-4754-95ac-75e861f0357b]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:45:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2af2bebc-dc54-460e-a959-678f0a5b5904 tempest-VolumesActionsTest-781391049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:37 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 Jun 16 08:45:37 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:37 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2af2bebc-dc54-460e-a959-678f0a5b5904 tempest-VolumesActionsTest-781391049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55" returned: 0 in 0.824s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:37 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-2af2bebc-dc54-460e-a959-678f0a5b5904 tempest-VolumesActionsTest-781391049 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.8d2c0a6e-17a7-42bd-b8da-c40ea09ba128fiu_cndc.img {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:45:37 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-2af2bebc-dc54-460e-a959-678f0a5b5904 tempest-VolumesActionsTest-781391049 None] Converted 1024.00 MB image at 181.87 MB/s Jun 16 08:45:37 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-2af2bebc-dc54-460e-a959-678f0a5b5904 tempest-VolumesActionsTest-781391049 None] 8d2c0a6e-17a7-42bd-b8da-c40ea09ba128 was raw, no need to convert to raw {{(pid=92348) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 16 08:45:40 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1,cinder:SELECT=3 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:45:47 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:45:49 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:45:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Flow 'volume_create_manager' (061c5a0d-e913-496b-9e23-19e5e0732bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:45:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701c15ee-1371-4a3f-9fcb-2bdd4acf81f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701c15ee-1371-4a3f-9fcb-2bdd4acf81f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1876345547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a801bd-cea5-49ea-947c-ee082c02ac06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='502fba564e224f2fa3dd19c63e97de73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:45:49Z,use_quota=True,user_id='22101aa960214902af45c7b53c7dc8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf72bec-e22d-4b4a-bc9f-67bf689fd7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf72bec-e22d-4b4a-bc9f-67bf689fd7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a05327d-c179-4f99-9f58-39e48396f201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a05327d-c179-4f99-9f58-39e48396f201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39a801bd-cea5-49ea-947c-ee082c02ac06', 'volume_name': 'volume-39a801bd-cea5-49ea-947c-ee082c02ac06', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d61f094-a332-4056-80e5-80854a0d2804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d61f094-a332-4056-80e5-80854a0d2804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326ab077-5cde-4124-89e9-7ae8b3996833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:49 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Volume 39a801bd-cea5-49ea-947c-ee082c02ac06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39a801bd-cea5-49ea-947c-ee082c02ac06', 'volume_size': 1} Jun 16 08:45:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:45:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2af2bebc-dc54-460e-a959-678f0a5b5904 tempest-VolumesActionsTest-781391049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.888s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:45:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2af2bebc-dc54-460e-a959-678f0a5b5904 tempest-VolumesActionsTest-781391049 None] Uploaded volume to glance image-id: 8d2c0a6e-17a7-42bd-b8da-c40ea09ba128. {{(pid=92348) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 16 08:45:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.302s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:45:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1328165506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebb5e16-94f2-4f68-bb83-859a8d4309d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22ebf3624cf844ed80a717799cdc956c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:45:30Z,use_quota=True,user_id='999ada0f4f5d4ed1af00c597d24078cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:45:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Creating volume 2ebb5e16-94f2-4f68-bb83-859a8d4309d4 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:45:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:45:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:45:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:45:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:45:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:45:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:45:57 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:45:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:57 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4 1073741824 Jun 16 08:45:57 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:57 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-2af2bebc-dc54-460e-a959-678f0a5b5904 tempest-VolumesActionsTest-781391049 None] Copy volume to image completed successfully. Jun 16 08:45:58 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4 1073741824" returned: 0 in 0.754s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:58 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4 Jun 16 08:45:58 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:58 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4" returned: 0 in 0.606s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.076s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1948044427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7816404-4781-463e-9078-c5f454bd0667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e6b4222c254b689962d1ef29645f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:45:30Z,use_quota=True,user_id='9e40466e519441e6bcc592ca9a04478b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Creating volume a7816404-4781-463e-9078-c5f454bd0667 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:45:58 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a7816404-4781-463e-9078-c5f454bd0667 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:58 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a7816404-4781-463e-9078-c5f454bd0667 1073741824 Jun 16 08:45:58 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a0cc2a-1396-4299-9b42-71dea0caee9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f74d2b49-d680-4ee4-b42e-54d05b1021b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:45:58 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Volume volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4 (2ebb5e16-94f2-4f68-bb83-859a8d4309d4): created successfully Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f74d2b49-d680-4ee4-b42e-54d05b1021b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:45:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Flow 'volume_create_manager' (68b44668-249b-4e1b-aef1-434e77421ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:45:58 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-52ff8c21-cb21-47cf-a6b9-da0818b65008 req-01b96088-fd00-4ff6-b3b8-319b36d2bc84 tempest-VolumesSnapshotsTestJSON-110213475 None] Created volume successfully. Jun 16 08:45:59 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Jun 16 08:45:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a7816404-4781-463e-9078-c5f454bd0667 1073741824" returned: 0 in 0.747s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:45:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a7816404-4781-463e-9078-c5f454bd0667 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:45:59 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a7816404-4781-463e-9078-c5f454bd0667 Jun 16 08:45:59 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:45:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:00 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a7816404-4781-463e-9078-c5f454bd0667" returned: 0 in 0.631s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.872s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1876345547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a801bd-cea5-49ea-947c-ee082c02ac06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='502fba564e224f2fa3dd19c63e97de73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:45:49Z,use_quota=True,user_id='22101aa960214902af45c7b53c7dc8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Creating volume 39a801bd-cea5-49ea-947c-ee082c02ac06 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:46:00 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-39a801bd-cea5-49ea-947c-ee082c02ac06 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:00 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-39a801bd-cea5-49ea-947c-ee082c02ac06 1073741824 Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f292e3fe-8046-409f-9f4e-abb83403f133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7816404-4781-463e-9078-c5f454bd0667', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:00 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201f18b3-13c9-428f-a269-07394c33534f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:00 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Volume volume-a7816404-4781-463e-9078-c5f454bd0667 (a7816404-4781-463e-9078-c5f454bd0667): created successfully Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201f18b3-13c9-428f-a269-07394c33534f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Flow 'volume_create_manager' (e585ce58-1c3e-4110-a3cc-1ba9235dd232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:00 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-66c2ea1d-4e1f-4ddd-8dcf-dd68fcfa1bee tempest-VolumesListAdminTestJSON-521308439 None] Created volume successfully. Jun 16 08:46:00 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-39a801bd-cea5-49ea-947c-ee082c02ac06 1073741824" returned: 0 in 0.833s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-39a801bd-cea5-49ea-947c-ee082c02ac06 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:01 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-39a801bd-cea5-49ea-947c-ee082c02ac06 Jun 16 08:46:01 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Flow 'volume_create_manager' (375d8e83-deb4-4981-9e29-45f81cd2b968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909d5f04-991b-4a89-92f5-f98418ce955f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909d5f04-991b-4a89-92f5-f98418ce955f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2097186217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=552b2468-3b0f-496c-b196-9ee23e520f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e6b4222c254b689962d1ef29645f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:46:01Z,use_quota=True,user_id='9e40466e519441e6bcc592ca9a04478b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc05f54-e237-43d4-8a57-eeceafeb4ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc05f54-e237-43d4-8a57-eeceafeb4ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4d1f84-e698-42c4-83ed-73f11f554b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4d1f84-e698-42c4-83ed-73f11f554b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '552b2468-3b0f-496c-b196-9ee23e520f7e', 'volume_name': 'volume-552b2468-3b0f-496c-b196-9ee23e520f7e', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f117250b-21fb-4f11-8461-8b1828ccbbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f117250b-21fb-4f11-8461-8b1828ccbbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afbce730-722d-4157-828f-560bcbe53813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:01 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Volume 552b2468-3b0f-496c-b196-9ee23e520f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-552b2468-3b0f-496c-b196-9ee23e520f7e', 'volume_size': 1} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:01 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-39a801bd-cea5-49ea-947c-ee082c02ac06" returned: 0 in 0.639s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.876s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326ab077-5cde-4124-89e9-7ae8b3996833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a801bd-cea5-49ea-947c-ee082c02ac06', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44fe2c34-ba78-48ab-af23-0d9a279c101f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43f715a-55a7-4ddd-a980-cd9868c7ed14]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:01 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Volume volume-39a801bd-cea5-49ea-947c-ee082c02ac06 (39a801bd-cea5-49ea-947c-ee082c02ac06): created successfully Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44fe2c34-ba78-48ab-af23-0d9a279c101f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:01 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Flow 'volume_create_manager' (061c5a0d-e913-496b-9e23-19e5e0732bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:01 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-649eecd5-dc73-4e1a-9aba-f25b821cb583 tempest-AttachVolumeShelveTestJSON-502799397 None] Created volume successfully. Jun 16 08:46:01 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 Jun 16 08:46:01 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:02 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55" returned: 0 in 0.714s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:02 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8cdd61-4111-429f-b3ac-39288efe8142]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:02 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 Jun 16 08:46:02 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:03 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55" returned: 0 in 0.729s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.2d49b37d-2de7-4d8d-a42e-f302f5eb34c625bb2ksi.img {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:03 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.2d49b37d-2de7-4d8d-a42e-f302f5eb34c625bb2ksi.img Jun 16 08:46:03 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:08 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.2d49b37d-2de7-4d8d-a42e-f302f5eb34c625bb2ksi.img" returned: 0 in 5.018s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:08 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9752836-1828-4535-8fce-95ca18484e1f]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:08 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 Jun 16 08:46:08 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:08 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55" returned: 0 in 0.850s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:08 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55, size 1024.00 MB, duration 5.02 sec, destination /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.2d49b37d-2de7-4d8d-a42e-f302f5eb34c625bb2ksi.img {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:46:08 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] Converted 1024.00 MB image at 204.03 MB/s Jun 16 08:46:08 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] 2d49b37d-2de7-4d8d-a42e-f302f5eb34c6 was raw, converting to qcow2 {{(pid=92348) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 16 08:46:09 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f855da0-92fb-4386-ae90-110b9404a7c5]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.2d49b37d-2de7-4d8d-a42e-f302f5eb34c625bb2ksi.img {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:09 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.2d49b37d-2de7-4d8d-a42e-f302f5eb34c625bb2ksi.img Jun 16 08:46:09 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:09 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.2d49b37d-2de7-4d8d-a42e-f302f5eb34c625bb2ksi.img" returned: 0 in 0.673s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.2d49b37d-2de7-4d8d-a42e-f302f5eb34c625bb2ksi.img {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:09 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.2d49b37d-2de7-4d8d-a42e-f302f5eb34c625bb2ksi.img Jun 16 08:46:09 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:10 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.2d49b37d-2de7-4d8d-a42e-f302f5eb34c625bb2ksi.img" returned: 1 in 0.682s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.2d49b37d-2de7-4d8d-a42e-f302f5eb34c625bb2ksi.img' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:46:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.2d49b37d-2de7-4d8d-a42e-f302f5eb34c625bb2ksi.img /opt/stack/data/cinder/conversion/vol_upload_dhd3961n {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:10 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.2d49b37d-2de7-4d8d-a42e-f302f5eb34c625bb2ksi.img /opt/stack/data/cinder/conversion/vol_upload_dhd3961n Jun 16 08:46:10 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:11 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.2d49b37d-2de7-4d8d-a42e-f302f5eb34c625bb2ksi.img /opt/stack/data/cinder/conversion/vol_upload_dhd3961n" returned: 0 in 0.674s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:11 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] Image conversion details: src /opt/stack/data/cinder/conversion/55347fa8-16be-4824-a869-cdfebfe59f55.temp_image.2d49b37d-2de7-4d8d-a42e-f302f5eb34c625bb2ksi.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_dhd3961n {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:46:11 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 16 08:46:11 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f163cb95-a90d-48b6-b5cc-a94477d04ab1]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dhd3961n {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:11 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dhd3961n Jun 16 08:46:11 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:11 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dhd3961n" returned: 0 in 0.670s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.321s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] Uploaded volume to glance image-id: 2d49b37d-2de7-4d8d-a42e-f302f5eb34c6. {{(pid=92348) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 16 08:46:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.069s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] Creating offline snapshot b98650e1-1993-49e9-b935-0e2aedcfef77 of volume 2ebb5e16-94f2-4f68-bb83-859a8d4309d4 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:46:12 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-42f879ce-43d7-4e2f-8e21-385f97317ac4 tempest-VolumesActionsTest-781391049 None] Copy volume to image completed successfully. Jun 16 08:46:12 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70c7b16-9471-4d2e-867e-4e764baf9a23]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:13 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4 Jun 16 08:46:13 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:13 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4" returned: 0 in 0.704s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:13 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77 1G Jun 16 08:46:13 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] Acquiring lock "cinder-55347fa8-16be-4824-a869-cdfebfe59f55-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] Lock "cinder-55347fa8-16be-4824-a869-cdfebfe59f55-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] Acquiring lock "cinder-quobyte-55347fa8-16be-4824-a869-cdfebfe59f55" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] Lock "cinder-quobyte-55347fa8-16be-4824-a869-cdfebfe59f55" acquired by "delete_volume" :: waited 0.032s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:14 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e192998-4abd-4dbd-ac5c-97adaf3668fb]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:14 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 Jun 16 08:46:14 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:14 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77 1G" returned: 0 in 0.948s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:14 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77 Jun 16 08:46:14 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:14 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55" returned: 0 in 0.777s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:14 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55 Jun 16 08:46:14 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:15 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77" returned: 0 in 0.714s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:15 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77 is being set with open permissions: ugo+rw Jun 16 08:46:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:15 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77 Jun 16 08:46:15 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:15 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-55347fa8-16be-4824-a869-cdfebfe59f55" returned: 0 in 0.693s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] Lock "cinder-quobyte-55347fa8-16be-4824-a869-cdfebfe59f55" released by "delete_volume" :: held 1.531s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:15 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] Created reservations ['f4c1182d-658f-4762-98dd-2a9df270422c', '998bcb61-a0c2-4c34-bb25-a2e5d4feda31', 'acf5a301-1dad-4796-b0d5-241a632fdb8d', 'ce7ac92d-09a5-4e45-bc24-7002d3d10c55'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:46:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:15 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:15 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:15 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:46:15 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:16 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77" returned: 0 in 0.681s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:16 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.info Jun 16 08:46:16 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-304e1b3c-010b-4dec-b0c3-2c20a4053e50 req-efd0e9f5-94c0-4573-891a-61a64de273ac tempest-AttachVolumeShelveTestJSON-502799397 None] No connector for attachment 8b482dde-7cc7-45b9-8890-9003d4ff4545; skipping storage backend terminate_connection call. {{(pid=92348) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 16 08:46:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-304e1b3c-010b-4dec-b0c3-2c20a4053e50 req-efd0e9f5-94c0-4573-891a-61a64de273ac tempest-AttachVolumeShelveTestJSON-502799397 None] Deleting attachment 8b482dde-7cc7-45b9-8890-9003d4ff4545. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:46:16 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.701s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:16 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:46:16 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] Deleted volume successfully. Jun 16 08:46:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-49237afd-d5d9-43c0-b4d4-c04e9347cf56 tempest-VolumesActionsTest-781391049 None] Lock "cinder-55347fa8-16be-4824-a869-cdfebfe59f55-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:16 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.info" returned: 0 in 0.694s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:16 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.info is being set with open permissions: ugo+rw Jun 16 08:46:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:16 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.info Jun 16 08:46:16 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:17 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.info" returned: 0 in 0.655s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.522s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.255s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:17 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2097186217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=552b2468-3b0f-496c-b196-9ee23e520f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e6b4222c254b689962d1ef29645f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:46:01Z,use_quota=True,user_id='9e40466e519441e6bcc592ca9a04478b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:46:17 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Creating volume 552b2468-3b0f-496c-b196-9ee23e520f7e {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:46:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:17 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:17 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:17 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:46:17 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:46:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-552b2468-3b0f-496c-b196-9ee23e520f7e 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:17 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-552b2468-3b0f-496c-b196-9ee23e520f7e 1073741824 Jun 16 08:46:17 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:17 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-40416496-8a41-42b8-8e19-a509648039c3 req-88812a1a-8ce0-45b7-9bf6-3cf54ff466ec tempest-VolumesSnapshotsTestJSON-110213475 None] Create snapshot completed successfully Jun 16 08:46:18 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-552b2468-3b0f-496c-b196-9ee23e520f7e 1073741824" returned: 0 in 0.890s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-552b2468-3b0f-496c-b196-9ee23e520f7e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:18 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-552b2468-3b0f-496c-b196-9ee23e520f7e Jun 16 08:46:18 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:18 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] Acquiring lock "cinder-b98650e1-1993-49e9-b935-0e2aedcfef77-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:18 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "cinder-b98650e1-1993-49e9-b935-0e2aedcfef77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:18 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] Acquiring lock "cinder-quobyte-2ebb5e16-94f2-4f68-bb83-859a8d4309d4" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:18 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "cinder-quobyte-2ebb5e16-94f2-4f68-bb83-859a8d4309d4" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:18 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] Acquiring lock "cinder-quobyte-b98650e1-1993-49e9-b935-0e2aedcfef77" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:18 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "cinder-quobyte-b98650e1-1993-49e9-b935-0e2aedcfef77" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:18 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] Deleting offline snapshot b98650e1-1993-49e9-b935-0e2aedcfef77 of volume 2ebb5e16-94f2-4f68-bb83-859a8d4309d4 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:46:18 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] snapshot_file for this snap is: volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:46:18 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc12ae33-9c29-4aa2-a773-feab103dac1a]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:18 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77 Jun 16 08:46:18 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:19 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-552b2468-3b0f-496c-b196-9ee23e520f7e" returned: 0 in 0.712s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:46:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afbce730-722d-4157-828f-560bcbe53813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-552b2468-3b0f-496c-b196-9ee23e520f7e', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec21938e-9957-4680-9fcb-08fa25441d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:19 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Volume volume-552b2468-3b0f-496c-b196-9ee23e520f7e (552b2468-3b0f-496c-b196-9ee23e520f7e): created successfully Jun 16 08:46:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec21938e-9957-4680-9fcb-08fa25441d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Flow 'volume_create_manager' (375d8e83-deb4-4981-9e29-45f81cd2b968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:19 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-a6b5ff42-8f56-49ba-96d8-da87eca8ac66 tempest-VolumesListAdminTestJSON-521308439 None] Created volume successfully. Jun 16 08:46:19 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77" returned: 0 in 0.898s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:46:19 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3020440-1661-43b1-a3ad-be7dbe9eadcd]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:19 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4 Jun 16 08:46:19 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Flow 'volume_create_manager' (15e35946-6f7f-4f88-8914-3890eaa91eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d0de71-5470-4d93-b43b-3d6fbe034913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d0de71-5470-4d93-b43b-3d6fbe034913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fae0d32303a4a6baa8dfebdd09b1e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:46:20Z,use_quota=True,user_id='dea52d967af844deb43d245fa6f153cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177c4b50-48bb-41a0-8092-4ea1be8a228c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177c4b50-48bb-41a0-8092-4ea1be8a228c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930e350f-6b3a-486a-9e88-a057d686bc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930e350f-6b3a-486a-9e88-a057d686bc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5', 'volume_name': 'volume-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b3dda1-8ae9-4c8f-921d-013c15964a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:20 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b3dda1-8ae9-4c8f-921d-013c15964a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32f3278-4445-4bb6-af0d-9bf1b5657b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:20 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Volume e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5', 'volume_size': 1} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fae0d32303a4a6baa8dfebdd09b1e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:46:20Z,use_quota=True,user_id='dea52d967af844deb43d245fa6f153cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Creating volume e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:46:20 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4" returned: 0 in 0.975s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:20 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5 1073741824 Jun 16 08:46:20 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:20 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77 Jun 16 08:46:20 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:21 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77" returned: 0 in 0.754s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:21 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77 Jun 16 08:46:21 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:21 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5 1073741824" returned: 0 in 0.858s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:21 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5 Jun 16 08:46:21 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:22 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4.b98650e1-1993-49e9-b935-0e2aedcfef77" returned: 0 in 0.717s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "cinder-quobyte-b98650e1-1993-49e9-b935-0e2aedcfef77" released by "_delete_snapshot" :: held 3.500s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "cinder-quobyte-2ebb5e16-94f2-4f68-bb83-859a8d4309d4" released by "delete_snapshot" :: held 3.542s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.quota [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] Created reservations ['81733069-183b-489f-9bc2-f625fa922138', '1c0442ab-c7d6-423c-8adf-291bb4a0efa4', '6f691f18-5c14-4986-aec9-f51cdc9371a8', 'd219c7c4-5a00-45ab-b08c-569591fb58c5'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:46:22 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5" returned: 0 in 0.711s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32f3278-4445-4bb6-af0d-9bf1b5657b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e565ea9-21b7-4b22-9f2e-54760f08a5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:22 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Volume volume-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5 (e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5): created successfully Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e565ea9-21b7-4b22-9f2e-54760f08a5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Flow 'volume_create_manager' (15e35946-6f7f-4f88-8914-3890eaa91eb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:22 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-be8bfa10-5a0e-4c19-850a-3a9c04c2da7d tempest-VolumesListAdminTestJSON-1641900781 None] Created volume successfully. Jun 16 08:46:22 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] Delete snapshot completed successfully. Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-47044751-f3dc-40ae-bb67-8d1d94b3e40e req-658679ea-92cb-47d5-84a6-a45657da6f3b tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "cinder-b98650e1-1993-49e9-b935-0e2aedcfef77-delete_snapshot" released by "delete_snapshot" :: held 3.717s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] Acquiring lock "cinder-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] Lock "cinder-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Flow 'volume_create_manager' (a7cf2b42-f59c-4968-a728-d817d1b6d67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53f059f-5a8e-441b-ae84-05ec3106580d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53f059f-5a8e-441b-ae84-05ec3106580d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1236539726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='90ebbc2b5cb34a769a2656b2b77de361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:46:23Z,use_quota=True,user_id='1ffc970e7a62422c9471a82991e75d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9641077-21df-4f15-8907-6dbe68396b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9641077-21df-4f15-8907-6dbe68396b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811901bd-cf15-4443-b44e-df03e951d78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811901bd-cf15-4443-b44e-df03e951d78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f', 'volume_name': 'volume-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbbf6727-ee41-496c-99de-337210c00564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbbf6727-ee41-496c-99de-337210c00564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8cd5b6-6d84-441b-a5ae-90dcc323b169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:22 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Volume 2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f', 'volume_size': 1} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1236539726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='90ebbc2b5cb34a769a2656b2b77de361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:46:23Z,use_quota=True,user_id='1ffc970e7a62422c9471a82991e75d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Creating volume 2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:46:22 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] Acquiring lock "cinder-quobyte-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:22 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f 1073741824 Jun 16 08:46:22 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] Lock "cinder-quobyte-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] Acquiring lock "cinder-552b2468-3b0f-496c-b196-9ee23e520f7e-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] Lock "cinder-552b2468-3b0f-496c-b196-9ee23e520f7e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcece1c5-bc7c-40bf-8c0d-5788056f28ed]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] Acquiring lock "cinder-quobyte-552b2468-3b0f-496c-b196-9ee23e520f7e" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] Lock "cinder-quobyte-552b2468-3b0f-496c-b196-9ee23e520f7e" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedc836d-bc7f-4e81-9e2a-a9a0115d4d89]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-552b2468-3b0f-496c-b196-9ee23e520f7e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:23 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5 Jun 16 08:46:23 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:23 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-552b2468-3b0f-496c-b196-9ee23e520f7e Jun 16 08:46:23 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] Acquiring lock "cinder-2ebb5e16-94f2-4f68-bb83-859a8d4309d4-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "cinder-2ebb5e16-94f2-4f68-bb83-859a8d4309d4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] Acquiring lock "cinder-quobyte-2ebb5e16-94f2-4f68-bb83-859a8d4309d4" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "cinder-quobyte-2ebb5e16-94f2-4f68-bb83-859a8d4309d4" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14d65a5-26ea-4f5e-95b3-b4e154717114]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:23 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4 Jun 16 08:46:23 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:23 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:23 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f 1073741824" returned: 0 in 0.924s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5" returned: 0 in 0.825s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:23 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5 Jun 16 08:46:23 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:23 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f Jun 16 08:46:23 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:24 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-552b2468-3b0f-496c-b196-9ee23e520f7e" returned: 0 in 1.007s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-552b2468-3b0f-496c-b196-9ee23e520f7e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:24 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-552b2468-3b0f-496c-b196-9ee23e520f7e Jun 16 08:46:24 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:24 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4" returned: 0 in 1.055s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:24 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4 Jun 16 08:46:24 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:24 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:24 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5" returned: 0 in 0.984s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f" returned: 0 in 0.938s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:24 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:46:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:24 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] Lock "cinder-quobyte-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5" released by "delete_volume" :: held 1.894s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8cd5b6-6d84-441b-a5ae-90dcc323b169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e35e319-4cfe-49b7-aede-3dbd57e79fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:24 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Volume volume-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f (2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f): created successfully Jun 16 08:46:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e35e319-4cfe-49b7-aede-3dbd57e79fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Flow 'volume_create_manager' (a7cf2b42-f59c-4968-a728-d817d1b6d67c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:24 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-552b2468-3b0f-496c-b196-9ee23e520f7e" returned: 0 in 0.804s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:24 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c8022e7d-8f4c-41f0-a43d-8da0a8c09740 tempest-VolumesGetTest-1823628986 None] Created volume successfully. Jun 16 08:46:24 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] Lock "cinder-quobyte-552b2468-3b0f-496c-b196-9ee23e520f7e" released by "delete_volume" :: held 1.884s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] Created reservations ['406ba7b9-464a-4222-8327-1b47181af021', 'ac7ced42-8a2c-4e8f-8a72-60cfb1d151ea', '5f454348-434d-4c53-a51e-16e722373a96', '232715b7-8496-4983-ade3-a693194dd84a'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] Created reservations ['e0bfd9d5-c1f2-404f-bbd9-26e1222afad1', '458e889e-2a5d-4c3a-9ffb-1e86683aa562', '86e182b7-347b-4bd2-8ddf-455890aa4f43', '641acdeb-c0ce-4747-ba7a-f8dd7764ccc2'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:25 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:46:25 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:25 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:46:25 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] Acquiring lock "cinder-a7816404-4781-463e-9078-c5f454bd0667-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] Lock "cinder-a7816404-4781-463e-9078-c5f454bd0667-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] Acquiring lock "cinder-quobyte-a7816404-4781-463e-9078-c5f454bd0667" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] Lock "cinder-quobyte-a7816404-4781-463e-9078-c5f454bd0667" acquired by "delete_volume" :: waited 0.037s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8ebd3e-6987-4a94-a577-317bff861e95]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a7816404-4781-463e-9078-c5f454bd0667 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:25 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ebb5e16-94f2-4f68-bb83-859a8d4309d4" returned: 0 in 1.366s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:25 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a7816404-4781-463e-9078-c5f454bd0667 Jun 16 08:46:25 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "cinder-quobyte-2ebb5e16-94f2-4f68-bb83-859a8d4309d4" released by "delete_volume" :: held 2.522s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.quota [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] Created reservations ['ab4b496e-819f-44bf-8df5-e3a3cef56005', '95c02b50-5e09-4836-a92a-75799a9e75d6', 'e4178bfe-92b0-4eb5-9700-658054f40d8d', '2ec07114-0520-459c-91ff-48db0d936bc9'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Flow 'volume_create_manager' (942efd21-32b1-41ca-a69c-de60564be35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce593a2-2b84-4ab1-b719-fead9c194df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce593a2-2b84-4ab1-b719-fead9c194df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:46:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1608987134',display_name='tempest-VolumesGetTest-Volume-1608212913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0366e863-0216-4674-908f-eb807f756cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebbc2b5cb34a769a2656b2b77de361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:46:26Z,use_quota=True,user_id='1ffc970e7a62422c9471a82991e75d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c43b525-9447-401a-aeff-963291c61470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c43b525-9447-401a-aeff-963291c61470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e7a6dc-003b-4ebb-a830-754d8d93d772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e7a6dc-003b-4ebb-a830-754d8d93d772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0366e863-0216-4674-908f-eb807f756cff', 'volume_name': 'volume-0366e863-0216-4674-908f-eb807f756cff', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a3015c-fa6b-4eaa-9dfe-4439a72736a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a3015c-fa6b-4eaa-9dfe-4439a72736a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce2a721-9f56-4846-8201-4c6ff69890dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:26 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Volume 0366e863-0216-4674-908f-eb807f756cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0366e863-0216-4674-908f-eb807f756cff', 'volume_size': 1} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:46:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1608987134',display_name='tempest-VolumesGetTest-Volume-1608212913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0366e863-0216-4674-908f-eb807f756cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebbc2b5cb34a769a2656b2b77de361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:46:26Z,use_quota=True,user_id='1ffc970e7a62422c9471a82991e75d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Creating volume 0366e863-0216-4674-908f-eb807f756cff {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:46:26 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0366e863-0216-4674-908f-eb807f756cff 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:26 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.149s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:46:26 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0366e863-0216-4674-908f-eb807f756cff 1073741824 Jun 16 08:46:26 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] Deleted volume successfully. Jun 16 08:46:26 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:26 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.151s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:46:26 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:46:26 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ecb0f9ac-8671-45d2-bec9-c9ecfa9406d5 tempest-VolumesListAdminTestJSON-1641900781 None] Lock "cinder-e7ac894e-b6e2-46c2-9356-f9ad9c86e3c5-delete_volume" released by "delete_volume" :: held 3.553s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:26 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] Deleted volume successfully. Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fe803302-9a54-4971-9ac1-fbf87439f9a1 tempest-VolumesListAdminTestJSON-521308439 None] Lock "cinder-552b2468-3b0f-496c-b196-9ee23e520f7e-delete_volume" released by "delete_volume" :: held 3.380s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:26 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a7816404-4781-463e-9078-c5f454bd0667" returned: 0 in 1.103s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a7816404-4781-463e-9078-c5f454bd0667 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:26 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a7816404-4781-463e-9078-c5f454bd0667 Jun 16 08:46:26 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:27 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.735s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:27 devstack cinder-volume[92348]: DEBUG cinder.manager [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:46:27 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] Deleted volume successfully. Jun 16 08:46:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-3b45d899-8db4-4a8e-97cd-587f0836a940 req-09e82eca-bb58-498d-a52e-84e1f9332fda tempest-VolumesSnapshotsTestJSON-110213475 None] Lock "cinder-2ebb5e16-94f2-4f68-bb83-859a8d4309d4-delete_volume" released by "delete_volume" :: held 3.793s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:27 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0366e863-0216-4674-908f-eb807f756cff 1073741824" returned: 0 in 1.082s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0366e863-0216-4674-908f-eb807f756cff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:27 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0366e863-0216-4674-908f-eb807f756cff Jun 16 08:46:27 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:27 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a7816404-4781-463e-9078-c5f454bd0667" returned: 0 in 0.765s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] Lock "cinder-quobyte-a7816404-4781-463e-9078-c5f454bd0667" released by "delete_volume" :: held 1.951s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:27 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] Created reservations ['28aecb6b-0f15-4411-9d18-8c5dd0b8d13d', '66ea501e-bb1c-4e4a-b0a5-5cf0f82d7d99', '2cfef199-f7c6-4c9c-83e9-6cb4d68d9570', 'ac83f222-1768-498f-940f-59d29f028bf6'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:46:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:27 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:46:27 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:28 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0366e863-0216-4674-908f-eb807f756cff" returned: 0 in 0.710s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:46:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce2a721-9f56-4846-8201-4c6ff69890dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0366e863-0216-4674-908f-eb807f756cff', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d258d1a-5b58-4651-8afb-bc9c5080b1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:28 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Volume volume-0366e863-0216-4674-908f-eb807f756cff (0366e863-0216-4674-908f-eb807f756cff): created successfully Jun 16 08:46:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d258d1a-5b58-4651-8afb-bc9c5080b1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Flow 'volume_create_manager' (942efd21-32b1-41ca-a69c-de60564be35c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-b3577199-cb63-4b13-9185-158b1debaf1b tempest-VolumesGetTest-1823628986 None] Created volume successfully. Jun 16 08:46:28 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.947s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:28 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:46:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] Deleted volume successfully. Jun 16 08:46:28 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-859ae8fb-5bd7-4061-84ee-fcc34e65a6d3 tempest-VolumesListAdminTestJSON-521308439 None] Lock "cinder-a7816404-4781-463e-9078-c5f454bd0667-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:28 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] Acquiring lock "cinder-1c34880e-ac40-4654-a307-dc90a47979be-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:28 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] Lock "cinder-1c34880e-ac40-4654-a307-dc90a47979be-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] Acquiring lock "cinder-quobyte-1c34880e-ac40-4654-a307-dc90a47979be" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] Lock "cinder-quobyte-1c34880e-ac40-4654-a307-dc90a47979be" acquired by "delete_volume" :: waited 0.023s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:29 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f815670c-94cf-4945-817c-20cde49162d3]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1c34880e-ac40-4654-a307-dc90a47979be {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:29 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1c34880e-ac40-4654-a307-dc90a47979be Jun 16 08:46:29 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] Acquiring lock "cinder-0366e863-0216-4674-908f-eb807f756cff-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] Lock "cinder-0366e863-0216-4674-908f-eb807f756cff-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] Acquiring lock "cinder-quobyte-0366e863-0216-4674-908f-eb807f756cff" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-0366e863-0216-4674-908f-eb807f756cff" acquired by "delete_volume" :: waited 0.037s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:29 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea0211a-40f5-4d1a-b092-858d1415ec64]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0366e863-0216-4674-908f-eb807f756cff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:29 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0366e863-0216-4674-908f-eb807f756cff Jun 16 08:46:29 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:46:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:30 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1c34880e-ac40-4654-a307-dc90a47979be" returned: 0 in 1.129s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1c34880e-ac40-4654-a307-dc90a47979be {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:30 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:46:30 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:30 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1c34880e-ac40-4654-a307-dc90a47979be Jun 16 08:46:30 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:30 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0366e863-0216-4674-908f-eb807f756cff" returned: 0 in 1.122s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0366e863-0216-4674-908f-eb807f756cff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:30 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0366e863-0216-4674-908f-eb807f756cff Jun 16 08:46:30 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:30 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1c34880e-ac40-4654-a307-dc90a47979be" returned: 0 in 0.731s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] Lock "cinder-quobyte-1c34880e-ac40-4654-a307-dc90a47979be" released by "delete_volume" :: held 1.922s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] Created reservations ['7b792d5f-ce47-4ba9-bce9-d3690523d08e', '6176f0bd-d8f7-4907-9b0b-f42daa8a97fd', 'a07d0578-09ef-40f8-ab77-529475fd51b1', '26d9efe3-73da-4f98-b8fd-ff4f819fedf8'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:46:31 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.898s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:31 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:46:31 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:31 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0366e863-0216-4674-908f-eb807f756cff" returned: 0 in 0.815s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-0366e863-0216-4674-908f-eb807f756cff" released by "delete_volume" :: held 2.038s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] Created reservations ['30293c25-c878-4aef-89c3-9e32fcf66842', '2af7319d-2d8f-40cd-9e85-e7fd07c04db4', '3e4bcf47-3713-46d8-9790-3f70ea2c1870', 'f19bfc6a-8a34-4088-9e9f-6145c791d172'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:31 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:46:31 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] Acquiring lock "cinder-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] Lock "cinder-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] Acquiring lock "cinder-quobyte-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f" acquired by "delete_volume" :: waited 0.030s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:32 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afeaf35-462f-4348-a43d-2814bce64838]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:32 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.127s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:32 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:46:32 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] Deleted volume successfully. Jun 16 08:46:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9fc8d9b9-1e48-4c89-8f7c-8bf2846b41f4 tempest-VolumesListAdminTestJSON-521308439 None] Lock "cinder-1c34880e-ac40-4654-a307-dc90a47979be-delete_volume" released by "delete_volume" :: held 3.340s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:32 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f Jun 16 08:46:32 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:32 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.031s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:32 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:46:32 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] Deleted volume successfully. Jun 16 08:46:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-13513d0b-a7da-4849-8ef2-422009b155cf tempest-VolumesGetTest-1823628986 None] Lock "cinder-0366e863-0216-4674-908f-eb807f756cff-delete_volume" released by "delete_volume" :: held 3.350s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:33 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f" returned: 0 in 0.973s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:33 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f Jun 16 08:46:33 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:33 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f" returned: 0 in 0.786s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:33 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f" released by "delete_volume" :: held 1.816s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] Created reservations ['ed0296f2-c8d1-45c9-b5e1-36628c73f012', '130f1519-cbd6-4fd2-b622-1d3578ee0362', '51d91e26-1b60-4029-86b4-40d873051a27', 'c8740a9d-d018-4ad7-8b98-9838b25147f2'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:34 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:46:34 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Flow 'volume_create_manager' (804bc7f6-7d36-4fff-bb52-54c0a7b413b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e465bfb3-e89a-482b-bfed-5d8218d1fb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e465bfb3-e89a-482b-bfed-5d8218d1fb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1448696409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd638362-ffb8-4852-b365-d09ddac61b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebbc2b5cb34a769a2656b2b77de361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:46:35Z,use_quota=True,user_id='1ffc970e7a62422c9471a82991e75d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8740ce0-6af2-45d1-802a-1c243a93b693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8740ce0-6af2-45d1-802a-1c243a93b693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392af070-2af3-4f56-aea6-bce7a5874ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392af070-2af3-4f56-aea6-bce7a5874ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd638362-ffb8-4852-b365-d09ddac61b33', 'volume_name': 'volume-cd638362-ffb8-4852-b365-d09ddac61b33', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2436b65-fa8b-4162-8c16-47f053fde03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:34 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2436b65-fa8b-4162-8c16-47f053fde03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52ec93e-81d2-4cd2-ab84-002a1e677225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:34 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Volume cd638362-ffb8-4852-b365-d09ddac61b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd638362-ffb8-4852-b365-d09ddac61b33', 'volume_size': 1} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1448696409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd638362-ffb8-4852-b365-d09ddac61b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebbc2b5cb34a769a2656b2b77de361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:46:35Z,use_quota=True,user_id='1ffc970e7a62422c9471a82991e75d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Creating volume cd638362-ffb8-4852-b365-d09ddac61b33 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:46:34 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:46:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.880s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:35 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:46:35 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] Deleted volume successfully. Jun 16 08:46:35 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 1073741824 Jun 16 08:46:35 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:35 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1dbac892-a421-477e-a79f-70c489803afc tempest-VolumesGetTest-1823628986 None] Lock "cinder-2ec36f7b-b4b8-4b97-b388-239fdfaf5e2f-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:35 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 1073741824" returned: 0 in 0.978s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:36 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 Jun 16 08:46:36 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:36 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33" returned: 0 in 0.641s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:46:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52ec93e-81d2-4cd2-ab84-002a1e677225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd638362-ffb8-4852-b365-d09ddac61b33', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74069d8-046f-4ad9-b5b2-ac3916c3915a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:36 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Volume volume-cd638362-ffb8-4852-b365-d09ddac61b33 (cd638362-ffb8-4852-b365-d09ddac61b33): created successfully Jun 16 08:46:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74069d8-046f-4ad9-b5b2-ac3916c3915a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Flow 'volume_create_manager' (804bc7f6-7d36-4fff-bb52-54c0a7b413b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:36 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c427cc00-8c2b-4c54-8f27-f6bcfce548f3 tempest-VolumesGetTest-1823628986 None] Created volume successfully. Jun 16 08:46:38 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:46:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Flow 'volume_create_manager' (eae40463-97b5-4cca-ac8a-0966e6d18cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d6be70-c858-470d-87af-6d84a8e46283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d6be70-c858-470d-87af-6d84a8e46283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1563659679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9307db83-4ce7-4e33-abe1-709a854f77a2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='90ebbc2b5cb34a769a2656b2b77de361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cd638362-ffb8-4852-b365-d09ddac61b33,status='creating',terminated_at=None,updated_at=2026-06-16T06:46:38Z,use_quota=True,user_id='1ffc970e7a62422c9471a82991e75d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6974a0-5e10-43c0-b7ee-2ade630510ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6974a0-5e10-43c0-b7ee-2ade630510ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd732d6-60c1-4f45-b5bf-22a2888ef238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd732d6-60c1-4f45-b5bf-22a2888ef238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9307db83-4ce7-4e33-abe1-709a854f77a2', 'volume_name': 'volume-9307db83-4ce7-4e33-abe1-709a854f77a2', 'volume_size': 1, 'source_volid': 'cd638362-ffb8-4852-b365-d09ddac61b33', 'source_volstatus': 'available'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082c6d12-1aa5-4f32-8c29-746d5f8a0fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082c6d12-1aa5-4f32-8c29-746d5f8a0fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9858571-a112-4391-af96-14bc1bc040de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:38 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Volume 9307db83-4ce7-4e33-abe1-709a854f77a2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9307db83-4ce7-4e33-abe1-709a854f77a2', 'volume_size': 1, 'source_volid': 'cd638362-ffb8-4852-b365-d09ddac61b33', 'source_volstatus': 'available'} Jun 16 08:46:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:38 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Cloning volume cd638362-ffb8-4852-b365-d09ddac61b33 to volume 9307db83-4ce7-4e33-abe1-709a854f77a2 Jun 16 08:46:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Creating offline snapshot 513b014c-e94d-4bfe-8f06-00acdd72ec8b of volume cd638362-ffb8-4852-b365-d09ddac61b33 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:46:38 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2de224-4719-488d-a91b-0465517fa3f7]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:38 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 Jun 16 08:46:38 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:39 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33" returned: 0 in 1.165s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:39 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b 1G Jun 16 08:46:39 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:40 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b 1G" returned: 0 in 0.908s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd638362-ffb8-4852-b365-d09ddac61b33 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:40 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd638362-ffb8-4852-b365-d09ddac61b33 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b Jun 16 08:46:40 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:41 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd638362-ffb8-4852-b365-d09ddac61b33 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b" returned: 0 in 0.800s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:41 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b is being set with open permissions: ugo+rw Jun 16 08:46:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:41 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b Jun 16 08:46:41 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:42 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b" returned: 0 in 0.687s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:42 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=70,cinder:UPDATE=92,cinder:INSERT=21,cinder:DELETE=9 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:46:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:42 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.info Jun 16 08:46:42 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:43 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.info" returned: 0 in 0.947s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:43 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.info is being set with open permissions: ugo+rw Jun 16 08:46:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:43 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.info Jun 16 08:46:43 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:43 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.info" returned: 0 in 0.767s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Acquiring lock "cinder-quobyte-9307db83-4ce7-4e33-abe1-709a854f77a2" by "_copy_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-9307db83-4ce7-4e33-abe1-709a854f77a2" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] snapshot: 513b014c-e94d-4bfe-8f06-00acdd72ec8b, volume: 9307db83-4ce7-4e33-abe1-709a854f77a2, {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 16 08:46:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:43 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e5a940-6e5a-4aea-aad7-5aeb62a52366]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:44 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b Jun 16 08:46:44 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:44 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b" returned: 0 in 0.934s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd638362-ffb8-4852-b365-d09ddac61b33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:46:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 16 08:46:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Creating direct copy from snapshot {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 16 08:46:44 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e15ba18-90c5-4629-9c97-797af0e4b043]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:45 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 Jun 16 08:46:45 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:45 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33" returned: 0 in 1.030s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:45 devstack cinder-volume[92348]: DEBUG cinder.utils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Path /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9307db83-4ce7-4e33-abe1-709a854f77a2 not found in is_blk_device check {{(pid=92348) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 16 08:46:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9307db83-4ce7-4e33-abe1-709a854f77a2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:45 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9307db83-4ce7-4e33-abe1-709a854f77a2 Jun 16 08:46:45 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:45 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:46:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Flow 'volume_create_manager' (36fe79cb-72d4-47d2-b4ca-213cfbb1ee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a573e464-e096-44c6-99d8-dcd44d8391e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a573e464-e096-44c6-99d8-dcd44d8391e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1296133692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580d8c46-2a7d-4cb3-be22-6b9f6401dc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959d470915894241bb9efaeaff807b6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:46:46Z,use_quota=True,user_id='2e487ade6a904f0a952f5c7b72360a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d35e212-34d5-4c01-91dc-bec963511754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d35e212-34d5-4c01-91dc-bec963511754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1683522-41fb-4af3-9200-6de066ea9f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1683522-41fb-4af3-9200-6de066ea9f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '580d8c46-2a7d-4cb3-be22-6b9f6401dc2d', 'volume_name': 'volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e413227-9f9d-4dc1-af5b-2d90938318f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e413227-9f9d-4dc1-af5b-2d90938318f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38356873-b1b1-42b1-8f5b-b49204f008fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:46 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Volume 580d8c46-2a7d-4cb3-be22-6b9f6401dc2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d', 'volume_size': 1} Jun 16 08:46:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:47 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:46:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Flow 'volume_create_manager' (67b0842b-4e57-475b-92f9-5a23737a0da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6c95f8-2fba-4cda-945a-c67de15f28b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6c95f8-2fba-4cda-945a-c67de15f28b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-302062155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22dd2a80-a91a-4376-b6df-7ad18c057109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9dc98c8d874ce7af37ea1357f82c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:46:47Z,use_quota=True,user_id='2ebca2beb29e46199829f963f06fdded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86975e58-c14b-443f-9912-f23a2f99b78b),volume_type_id=86975e58-c14b-443f-9912-f23a2f99b78b)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a5e37e-a4f4-46ec-9c6c-ffbc95ae710b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a5e37e-a4f4-46ec-9c6c-ffbc95ae710b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bada54d1-36f4-47a0-96cc-c0a5d579a6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bada54d1-36f4-47a0-96cc-c0a5d579a6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22dd2a80-a91a-4376-b6df-7ad18c057109', 'volume_name': 'volume-22dd2a80-a91a-4376-b6df-7ad18c057109', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2798c2-c2b6-46b3-85c7-ec8e61fb52c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2798c2-c2b6-46b3-85c7-ec8e61fb52c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfdce8e-d162-402b-ae41-0c7419e0ea60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:47 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Volume 22dd2a80-a91a-4376-b6df-7ad18c057109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22dd2a80-a91a-4376-b6df-7ad18c057109', 'volume_size': 1} Jun 16 08:46:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:51 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=74,cinder:UPDATE=100,cinder:INSERT=26,cinder:DELETE=8 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:46:51 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9307db83-4ce7-4e33-abe1-709a854f77a2" returned: 0 in 5.829s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:51 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4265904-3602-479e-814a-45c7876fa966]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:51 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 Jun 16 08:46:51 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:52 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33" returned: 0 in 0.819s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:52 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9307db83-4ce7-4e33-abe1-709a854f77a2 {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:46:52 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Converted 1024.00 MB image at 175.64 MB/s Jun 16 08:46:52 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9307db83-4ce7-4e33-abe1-709a854f77a2 is being set with open permissions: ugo+rw Jun 16 08:46:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9307db83-4ce7-4e33-abe1-709a854f77a2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:52 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9307db83-4ce7-4e33-abe1-709a854f77a2 Jun 16 08:46:52 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:53 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9307db83-4ce7-4e33-abe1-709a854f77a2" returned: 0 in 0.581s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-9307db83-4ce7-4e33-abe1-709a854f77a2" released by "_copy_volume_from_snapshot" :: held 9.305s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Acquiring lock "cinder-quobyte-513b014c-e94d-4bfe-8f06-00acdd72ec8b" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:46:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-513b014c-e94d-4bfe-8f06-00acdd72ec8b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:46:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Deleting offline snapshot 513b014c-e94d-4bfe-8f06-00acdd72ec8b of volume cd638362-ffb8-4852-b365-d09ddac61b33 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:46:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] snapshot_file for this snap is: volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:46:53 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0b2d52-b58d-4600-9c69-f46ee85b93f5]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:53 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b Jun 16 08:46:53 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:53 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b" returned: 0 in 0.693s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd638362-ffb8-4852-b365-d09ddac61b33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:46:53 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[061dd0ba-d02a-4c5f-865f-bcda689eeddf]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:46:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:54 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 Jun 16 08:46:54 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:54 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33" returned: 0 in 0.684s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:54 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b Jun 16 08:46:54 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:55 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b" returned: 0 in 0.658s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:55 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b Jun 16 08:46:55 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:55 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33.513b014c-e94d-4bfe-8f06-00acdd72ec8b" returned: 0 in 0.582s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-513b014c-e94d-4bfe-8f06-00acdd72ec8b" released by "_delete_snapshot" :: held 2.720s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:46:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.544s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.901s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1296133692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580d8c46-2a7d-4cb3-be22-6b9f6401dc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959d470915894241bb9efaeaff807b6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:46:46Z,use_quota=True,user_id='2e487ade6a904f0a952f5c7b72360a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:46:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Creating volume 580d8c46-2a7d-4cb3-be22-6b9f6401dc2d {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:46:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:46:55 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:46:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:56 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d 1073741824 Jun 16 08:46:56 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9858571-a112-4391-af96-14bc1bc040de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9307db83-4ce7-4e33-abe1-709a854f77a2', 'volume_size': 1, 'source_volid': 'cd638362-ffb8-4852-b365-d09ddac61b33', 'source_volstatus': 'available'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:56 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:56 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c347425-83a7-4134-b7d9-cdad17dd8cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:56 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Volume volume-9307db83-4ce7-4e33-abe1-709a854f77a2 (9307db83-4ce7-4e33-abe1-709a854f77a2): created successfully Jun 16 08:46:56 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c347425-83a7-4134-b7d9-cdad17dd8cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:56 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Flow 'volume_create_manager' (eae40463-97b5-4cca-ac8a-0966e6d18cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:56 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-0c980a45-8242-4ed4-ba73-f3f7bfc1f341 tempest-VolumesGetTest-1823628986 None] Created volume successfully. Jun 16 08:46:56 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d 1073741824" returned: 0 in 0.803s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:56 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d Jun 16 08:46:56 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:57 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d" returned: 0 in 0.579s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.509s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-302062155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22dd2a80-a91a-4376-b6df-7ad18c057109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9dc98c8d874ce7af37ea1357f82c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:46:47Z,use_quota=True,user_id='2ebca2beb29e46199829f963f06fdded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86975e58-c14b-443f-9912-f23a2f99b78b),volume_type_id=86975e58-c14b-443f-9912-f23a2f99b78b)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Creating volume 22dd2a80-a91a-4376-b6df-7ad18c057109 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:46:57 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dd2a80-a91a-4376-b6df-7ad18c057109 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38356873-b1b1-42b1-8f5b-b49204f008fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:57 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dd2a80-a91a-4376-b6df-7ad18c057109 1073741824 Jun 16 08:46:57 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4289a7-2d63-4d9b-a74b-6bf7f63c45c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:57 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Volume volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d (580d8c46-2a7d-4cb3-be22-6b9f6401dc2d): created successfully Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4289a7-2d63-4d9b-a74b-6bf7f63c45c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Flow 'volume_create_manager' (36fe79cb-72d4-47d2-b4ca-213cfbb1ee68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:57 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c9aa30dc-752f-4df7-8351-87fb7aabf8ac tempest-SnapshotMetadataTestJSON-2105102517 None] Created volume successfully. Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Flow 'volume_create_manager' (9b2655a9-97c1-4c3d-9a40-79468d12b4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e360a9b-f065-4d7d-a576-f24ac02c70f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e360a9b-f065-4d7d-a576-f24ac02c70f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:46:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-791636081',display_name='tempest-VolumesGetTest-Volume-1678786511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ea9498-41ef-4870-964c-2965b5bbf9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebbc2b5cb34a769a2656b2b77de361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:46:58Z,use_quota=True,user_id='1ffc970e7a62422c9471a82991e75d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ef07ba-b82d-4ebd-85c4-1e0a6ae1c0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ef07ba-b82d-4ebd-85c4-1e0a6ae1c0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7c5ee8-6325-48ce-8bfd-8cb40196c0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7c5ee8-6325-48ce-8bfd-8cb40196c0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4ea9498-41ef-4870-964c-2965b5bbf9a3', 'volume_name': 'volume-e4ea9498-41ef-4870-964c-2965b5bbf9a3', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a471dc5b-97fe-442b-a069-548ada80e89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a471dc5b-97fe-442b-a069-548ada80e89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85bc3ef2-e553-49a7-874e-77b924a71ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:57 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Volume e4ea9498-41ef-4870-964c-2965b5bbf9a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4ea9498-41ef-4870-964c-2965b5bbf9a3', 'volume_size': 1} Jun 16 08:46:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:58 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dd2a80-a91a-4376-b6df-7ad18c057109 1073741824" returned: 0 in 0.771s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dd2a80-a91a-4376-b6df-7ad18c057109 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:58 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dd2a80-a91a-4376-b6df-7ad18c057109 Jun 16 08:46:58 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:58 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dd2a80-a91a-4376-b6df-7ad18c057109" returned: 0 in 0.605s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.061s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:46:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-791636081',display_name='tempest-VolumesGetTest-Volume-1678786511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4ea9498-41ef-4870-964c-2965b5bbf9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebbc2b5cb34a769a2656b2b77de361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:46:58Z,use_quota=True,user_id='1ffc970e7a62422c9471a82991e75d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Creating volume e4ea9498-41ef-4870-964c-2965b5bbf9a3 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:46:58 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e4ea9498-41ef-4870-964c-2965b5bbf9a3 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfdce8e-d162-402b-ae41-0c7419e0ea60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22dd2a80-a91a-4376-b6df-7ad18c057109', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:58 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e4ea9498-41ef-4870-964c-2965b5bbf9a3 1073741824 Jun 16 08:46:58 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e8eac7-5377-4f99-b6bf-6e989dbebcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:46:58 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Volume volume-22dd2a80-a91a-4376-b6df-7ad18c057109 (22dd2a80-a91a-4376-b6df-7ad18c057109): created successfully Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e8eac7-5377-4f99-b6bf-6e989dbebcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:46:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Flow 'volume_create_manager' (67b0842b-4e57-475b-92f9-5a23737a0da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:46:58 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-e3209c3e-4c1f-4b6c-8cd9-2a68658bc65c tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Created volume successfully. Jun 16 08:46:59 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Jun 16 08:46:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e4ea9498-41ef-4870-964c-2965b5bbf9a3 1073741824" returned: 0 in 0.748s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:46:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e4ea9498-41ef-4870-964c-2965b5bbf9a3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:46:59 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e4ea9498-41ef-4870-964c-2965b5bbf9a3 Jun 16 08:46:59 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2a04fe96-cd2c-4930-a1a4-a71250810783 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2a04fe96-cd2c-4930-a1a4-a71250810783 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2a04fe96-cd2c-4930-a1a4-a71250810783 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2a04fe96-cd2c-4930-a1a4-a71250810783 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2a04fe96-cd2c-4930-a1a4-a71250810783 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2a04fe96-cd2c-4930-a1a4-a71250810783 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:00 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:47:00 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:00 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e4ea9498-41ef-4870-964c-2965b5bbf9a3" returned: 0 in 0.747s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.868s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85bc3ef2-e553-49a7-874e-77b924a71ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4ea9498-41ef-4870-964c-2965b5bbf9a3', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4bddc63-2399-4e8f-8587-d40edada1a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] Creating offline snapshot d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94 of volume 580d8c46-2a7d-4cb3-be22-6b9f6401dc2d {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:47:00 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Volume volume-e4ea9498-41ef-4870-964c-2965b5bbf9a3 (e4ea9498-41ef-4870-964c-2965b5bbf9a3): created successfully Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4bddc63-2399-4e8f-8587-d40edada1a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Flow 'volume_create_manager' (9b2655a9-97c1-4c3d-9a40-79468d12b4a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9741daa-5e73-4e13-83b5-e40f7f823418]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:00 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ae034c57-5b01-4d8f-9c12-dca506640843 tempest-VolumesGetTest-1823628986 None] Created volume successfully. Jun 16 08:47:00 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d Jun 16 08:47:00 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:00 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2a04fe96-cd2c-4930-a1a4-a71250810783 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.917s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:00 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-2a04fe96-cd2c-4930-a1a4-a71250810783 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:47:00 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-2a04fe96-cd2c-4930-a1a4-a71250810783 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Retype volume completed successfully. Jun 16 08:47:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] Acquiring lock "cinder-e4ea9498-41ef-4870-964c-2965b5bbf9a3-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] Lock "cinder-e4ea9498-41ef-4870-964c-2965b5bbf9a3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] Acquiring lock "cinder-quobyte-e4ea9498-41ef-4870-964c-2965b5bbf9a3" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-e4ea9498-41ef-4870-964c-2965b5bbf9a3" acquired by "delete_volume" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:01 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ad5a02-542d-4e3e-ae90-68f1a43a1b0a]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e4ea9498-41ef-4870-964c-2965b5bbf9a3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:01 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e4ea9498-41ef-4870-964c-2965b5bbf9a3 Jun 16 08:47:01 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:01 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d" returned: 0 in 0.890s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Acquiring lock "cinder-22dd2a80-a91a-4376-b6df-7ad18c057109-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:01 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94 1G Jun 16 08:47:01 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Lock "cinder-22dd2a80-a91a-4376-b6df-7ad18c057109-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Acquiring lock "cinder-quobyte-22dd2a80-a91a-4376-b6df-7ad18c057109" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Lock "cinder-quobyte-22dd2a80-a91a-4376-b6df-7ad18c057109" acquired by "delete_volume" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:01 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[af40424e-9544-464d-a328-3f8387be2da8]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dd2a80-a91a-4376-b6df-7ad18c057109 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:01 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dd2a80-a91a-4376-b6df-7ad18c057109 Jun 16 08:47:01 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:01 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e4ea9498-41ef-4870-964c-2965b5bbf9a3" returned: 0 in 0.813s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e4ea9498-41ef-4870-964c-2965b5bbf9a3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:02 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e4ea9498-41ef-4870-964c-2965b5bbf9a3 Jun 16 08:47:02 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:02 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94 1G" returned: 0 in 1.222s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:02 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dd2a80-a91a-4376-b6df-7ad18c057109" returned: 0 in 1.104s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dd2a80-a91a-4376-b6df-7ad18c057109 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:02 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94 Jun 16 08:47:02 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:02 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dd2a80-a91a-4376-b6df-7ad18c057109 Jun 16 08:47:02 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:02 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e4ea9498-41ef-4870-964c-2965b5bbf9a3" returned: 0 in 0.837s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-e4ea9498-41ef-4870-964c-2965b5bbf9a3" released by "delete_volume" :: held 1.688s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:02 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] Created reservations ['c7854885-de6b-4867-959e-8453b3399dfb', '4dcde171-5dcc-4950-8001-7400afbcf4aa', 'a1f0ae62-300e-498b-84ca-bc0983c47a77', 'e1d30819-3ba4-464e-9a89-51a442ead78e'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:47:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:02 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:47:02 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:03 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:03 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dd2a80-a91a-4376-b6df-7ad18c057109" returned: 0 in 0.648s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94" returned: 0 in 0.694s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:03 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94 is being set with open permissions: ugo+rw Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Lock "cinder-quobyte-22dd2a80-a91a-4376-b6df-7ad18c057109" released by "delete_volume" :: held 1.819s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:03 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94 Jun 16 08:47:03 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:03 devstack cinder-volume[92348]: WARNING cinder.quota [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:47:03 devstack cinder-volume[92348]: WARNING cinder.quota [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Created reservations ['1cfbfe41-fb8b-4d0f-aee8-60657760c70c', '97c6af4b-2079-471c-acef-0361e51b9ef0', '78abef01-2ec7-4fac-aa91-6e0d364d4695', '3ebaafe7-787c-404e-8e0f-3a235ee1befc'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] Acquiring lock "cinder-9307db83-4ce7-4e33-abe1-709a854f77a2-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:03 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:47:03 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] Lock "cinder-9307db83-4ce7-4e33-abe1-709a854f77a2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] Acquiring lock "cinder-quobyte-9307db83-4ce7-4e33-abe1-709a854f77a2" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-9307db83-4ce7-4e33-abe1-709a854f77a2" acquired by "delete_volume" :: waited 0.020s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfc3a1a-b5ba-45c9-8c7a-3f7a7062616b]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9307db83-4ce7-4e33-abe1-709a854f77a2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:03 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.728s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:47:03 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] Deleted volume successfully. Jun 16 08:47:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5ef76b24-46e4-4389-a4bc-4ee64a925d2a tempest-VolumesGetTest-1823628986 None] Lock "cinder-e4ea9498-41ef-4870-964c-2965b5bbf9a3-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:03 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9307db83-4ce7-4e33-abe1-709a854f77a2 Jun 16 08:47:03 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:04 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94" returned: 0 in 0.850s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:04 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.info Jun 16 08:47:04 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:04 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.780s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:04 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:47:04 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Deleted volume successfully. Jun 16 08:47:04 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4e55ddf6-ace8-48a6-acd5-c8c00534c5e6 tempest-VolumeRetypeWithoutMigrationTest-1226062777 None] Lock "cinder-22dd2a80-a91a-4376-b6df-7ad18c057109-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:04 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9307db83-4ce7-4e33-abe1-709a854f77a2" returned: 0 in 0.939s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9307db83-4ce7-4e33-abe1-709a854f77a2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:04 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9307db83-4ce7-4e33-abe1-709a854f77a2 Jun 16 08:47:04 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:04 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.info" returned: 0 in 0.698s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:04 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.info is being set with open permissions: ugo+rw Jun 16 08:47:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:04 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.info Jun 16 08:47:04 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9307db83-4ce7-4e33-abe1-709a854f77a2" returned: 0 in 0.735s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:05 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-9307db83-4ce7-4e33-abe1-709a854f77a2" released by "delete_volume" :: held 1.741s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:05 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] Created reservations ['a7425d72-8d26-4552-bc1f-59ec52f07f19', '42873e1c-4981-464a-9a9e-32f26dcdad5d', '5044eaa7-54f8-429e-816a-a57e5628bb2c', '39e3ec05-5ddf-48a4-805a-cb6662800234'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:47:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:05 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:47:05 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:05 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.info" returned: 0 in 0.675s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.212s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:05 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-6edb289e-c308-4470-8a42-e19acd693ce3 tempest-SnapshotMetadataTestJSON-2105102517 None] Create snapshot completed successfully Jun 16 08:47:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] Acquiring lock "cinder-cd638362-ffb8-4852-b365-d09ddac61b33-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] Lock "cinder-cd638362-ffb8-4852-b365-d09ddac61b33-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] Acquiring lock "cinder-quobyte-cd638362-ffb8-4852-b365-d09ddac61b33" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-cd638362-ffb8-4852-b365-d09ddac61b33" acquired by "delete_volume" :: waited 0.014s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[001ac003-132e-414c-bd35-beba78e8495c]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:06 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 Jun 16 08:47:06 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:06 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.873s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:47:06 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] Deleted volume successfully. Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-05803877-05e9-430c-b7bb-456ed8309d90 tempest-VolumesGetTest-1823628986 None] Lock "cinder-9307db83-4ce7-4e33-abe1-709a854f77a2-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] Acquiring lock "cinder-d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "cinder-d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] Acquiring lock "cinder-quobyte-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "cinder-quobyte-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] Acquiring lock "cinder-quobyte-d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "cinder-quobyte-d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] Deleting offline snapshot d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94 of volume 580d8c46-2a7d-4cb3-be22-6b9f6401dc2d {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] snapshot_file for this snap is: volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6b014a-97d1-43cc-b9fd-d9fda3020f0a]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:06 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33" returned: 0 in 0.847s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:06 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33 Jun 16 08:47:07 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:07 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94 Jun 16 08:47:07 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:07 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cd638362-ffb8-4852-b365-d09ddac61b33" returned: 0 in 0.880s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-cd638362-ffb8-4852-b365-d09ddac61b33" released by "delete_volume" :: held 1.848s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:07 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94" returned: 0 in 1.008s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:47:07 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e4abb9-52a7-4b45-815e-676c3b13069d]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:08 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] Created reservations ['d3804906-2c4e-45fb-b711-1bfe07e3ec04', 'e136f8eb-e426-4526-a02b-9db6b180a649', '0eac3db8-227a-4159-8530-c4ee126309c0', 'fa4861a3-27ed-4119-a484-9cf3085bcb00'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:47:08 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d Jun 16 08:47:08 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:08 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] Acquiring lock "cinder-39a801bd-cea5-49ea-947c-ee082c02ac06-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:08 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:08 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:08 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "cinder-39a801bd-cea5-49ea-947c-ee082c02ac06-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:08 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:47:08 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:08 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] Acquiring lock "cinder-quobyte-39a801bd-cea5-49ea-947c-ee082c02ac06" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:08 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "cinder-quobyte-39a801bd-cea5-49ea-947c-ee082c02ac06" acquired by "delete_volume" :: waited 0.030s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:08 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf537c2-68b4-4db0-b570-ecf594e22149]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-39a801bd-cea5-49ea-947c-ee082c02ac06 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:08 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-39a801bd-cea5-49ea-947c-ee082c02ac06 Jun 16 08:47:08 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:09 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d" returned: 0 in 1.105s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:09 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.882s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:09 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:47:09 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] Deleted volume successfully. Jun 16 08:47:09 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94 Jun 16 08:47:09 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-57adfff0-f91d-4af0-b77a-fd6ee473eda3 tempest-VolumesGetTest-1823628986 None] Lock "cinder-cd638362-ffb8-4852-b365-d09ddac61b33-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:09 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-39a801bd-cea5-49ea-947c-ee082c02ac06" returned: 0 in 0.936s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-39a801bd-cea5-49ea-947c-ee082c02ac06 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:09 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-39a801bd-cea5-49ea-947c-ee082c02ac06 Jun 16 08:47:09 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:09 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:47:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Flow 'volume_create_manager' (a7d6f6b5-6360-489b-8051-6797656d108d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70525cfe-c2c8-4999-a8d0-f403e88097ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70525cfe-c2c8-4999-a8d0-f403e88097ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2068155884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d53b949b-cf35-4444-ac44-908efaedf9b0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='90ebbc2b5cb34a769a2656b2b77de361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:47:10Z,use_quota=True,user_id='1ffc970e7a62422c9471a82991e75d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe013dc-2847-49aa-a054-8b94e5e9ad39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe013dc-2847-49aa-a054-8b94e5e9ad39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908e8195-5a9b-4cfe-869a-d3d69cf569a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:09 devstack cinder-volume[92348]: DEBUG cinder.image.glance [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Creating Keystone auth plugin from conf {{(pid=92348) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 16 08:47:10 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-39a801bd-cea5-49ea-947c-ee082c02ac06" returned: 0 in 0.693s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:10 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94" returned: 0 in 1.014s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "cinder-quobyte-39a801bd-cea5-49ea-947c-ee082c02ac06" released by "delete_volume" :: held 1.771s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:10 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94 Jun 16 08:47:10 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] Created reservations ['c6028441-ec59-4449-b218-0b0a06d1d4ed', '5dca4719-6637-4b64-87ae-284f04d21079', '4ff7269f-5a88-4733-bf89-2d862db3acfa', 'b9817af4-6e07-4fa5-9c7a-2dff59536677'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:10 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:47:10 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908e8195-5a9b-4cfe-869a-d3d69cf569a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd53b949b-cf35-4444-ac44-908efaedf9b0', 'volume_name': 'volume-d53b949b-cf35-4444-ac44-908efaedf9b0', 'volume_size': 1, 'image_id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '038e50e6f4094f25b7da1abcd3989b23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'created_at': datetime.datetime(2026, 6, 16, 6, 33, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 34, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e6b9e3-d468-46db-87e0-40b0d9b52f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e6b9e3-d468-46db-87e0-40b0d9b52f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4063bb-39df-4a79-a20d-21e4a8e3506a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:10 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Volume d53b949b-cf35-4444-ac44-908efaedf9b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d53b949b-cf35-4444-ac44-908efaedf9b0', 'volume_size': 1, 'image_id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '038e50e6f4094f25b7da1abcd3989b23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'created_at': datetime.datetime(2026, 6, 16, 6, 33, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 34, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Trying to clone d53b949b-cf35-4444-ac44-908efaedf9b0 from image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}]). {{(pid=92348) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] Acquiring lock "cinder-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "cinder-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] Acquiring lock "cinder-quobyte-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "cinder-quobyte-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2" acquired by "delete_volume" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[55eec9e0-069b-45d1-b452-8382a78dc4bf]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:10 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d.d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94" returned: 0 in 0.874s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:10 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2 Jun 16 08:47:10 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "cinder-quobyte-d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94" released by "_delete_snapshot" :: held 4.207s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "cinder-quobyte-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d" released by "delete_snapshot" :: held 4.246s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:11 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.862s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:11 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:47:11 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] Deleted volume successfully. Jun 16 08:47:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-63496791-b1f2-4b09-8b77-c34136673233 tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "cinder-39a801bd-cea5-49ea-947c-ee082c02ac06-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:11 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_9o5if0bpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 16 08:47:11 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Image download 20.69 MB at 20.69 MB/s Jun 16 08:47:11 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] Created reservations ['db81df28-b78d-4c1f-89e8-8bd022f14fee', 'f0b84a2e-4342-4be5-84b3-7313bbb8b240', '70fb3c19-4f93-4f40-a1db-34197247e33a', 'd0bfd554-de38-4dcf-9513-6c3877dfcbac'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:47:11 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2c6e7c-1a56-461b-8b44-69f7f74ae271]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_9o5if0bpdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:11 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] Delete snapshot completed successfully. Jun 16 08:47:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8f3f4b11-5658-49d5-8e58-c9645d7a48d3 tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "cinder-d3b8cf39-46d3-4b97-9a30-ae93e5dfdb94-delete_snapshot" released by "delete_snapshot" :: held 4.497s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:11 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_9o5if0bpdevstack@QuobyteHD Jun 16 08:47:11 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:11 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2" returned: 0 in 0.932s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:11 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2 Jun 16 08:47:11 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:11 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_9o5if0bpdevstack@QuobyteHD" returned: 0 in 0.710s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:11 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Temporary image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec is fetched for user 1ffc970e7a62422c9471a82991e75d0d. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 16 08:47:12 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ba1a63-f2e0-4e7e-82c6-d92921cbb76d]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_9o5if0bpdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:12 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_9o5if0bpdevstack@QuobyteHD Jun 16 08:47:12 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] Acquiring lock "cinder-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "cinder-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] Acquiring lock "cinder-quobyte-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "cinder-quobyte-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d" acquired by "delete_volume" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:12 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2" returned: 0 in 0.744s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:12 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a50449-ba88-480d-b761-d8b060d26f59]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "cinder-quobyte-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2" released by "delete_volume" :: held 1.760s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:12 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] Created reservations ['e62bcaa1-f024-45e3-8b3f-7407c31be709', 'e63487ae-848e-4dd3-9dbf-ea11fa60fa40', '0490b50e-b5fa-4a1f-8834-a8b253f5d290', '5e44fe0f-53d4-40bc-851a-47cf6089c176'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:47:12 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d Jun 16 08:47:12 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:12 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:47:12 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:13 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_9o5if0bpdevstack@QuobyteHD" returned: 0 in 0.964s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2068155884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d53b949b-cf35-4444-ac44-908efaedf9b0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='90ebbc2b5cb34a769a2656b2b77de361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:47:10Z,use_quota=True,user_id='1ffc970e7a62422c9471a82991e75d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:47:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Creating volume d53b949b-cf35-4444-ac44-908efaedf9b0 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:47:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:47:13 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:47:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:13 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 1073741824 Jun 16 08:47:13 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:13 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d" returned: 0 in 0.986s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:13 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d Jun 16 08:47:13 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:13 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.925s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:13 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:47:13 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] Deleted volume successfully. Jun 16 08:47:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2fde2049-92f8-4552-ab3f-25c88d63e469 tempest-AttachVolumeShelveTestJSON-502799397 None] Lock "cinder-29e3e0c3-0a2a-48ed-8bde-1018ed46b9d2-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:14 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 1073741824" returned: 0 in 1.095s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:14 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 Jun 16 08:47:14 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:14 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d" returned: 0 in 0.886s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "cinder-quobyte-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d" released by "delete_volume" :: held 1.945s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:14 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] Created reservations ['7858b76d-3188-4e19-a62b-affcb4a6452c', 'fd27fe80-daac-4ace-a42a-8e4e02b5a690', 'bd5eede6-db52-48f6-9588-11ffca8b0eb2', '2b01454a-4854-402b-a963-ec717bfb1e03'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:47:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:14 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:14 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:14 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:47:14 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:15 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0" returned: 0 in 0.831s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:15 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:47:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:15 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Attempting download of 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec ((None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}])) to volume d53b949b-cf35-4444-ac44-908efaedf9b0. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 16 08:47:15 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d82cddc-3005-4348-bdce-97d854407476]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_ir4pr8vx {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:15 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.843s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:15 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:47:15 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] Deleted volume successfully. Jun 16 08:47:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-290e5b7e-5297-447c-80ab-7c355a59b7f7 tempest-SnapshotMetadataTestJSON-2105102517 None] Lock "cinder-580d8c46-2a7d-4cb3-be22-6b9f6401dc2d-delete_volume" released by "delete_volume" :: held 3.030s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:15 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_ir4pr8vx Jun 16 08:47:15 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:16 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_ir4pr8vx" returned: 0 in 0.842s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_ir4pr8vx {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:16 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_ir4pr8vx Jun 16 08:47:16 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:16 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_ir4pr8vx" returned: 1 in 0.893s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_ir4pr8vx' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:47:16 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32f8f99-ec75-4d73-91eb-4adf4a0b9f82]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_9o5if0bpdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:17 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_9o5if0bpdevstack@QuobyteHD Jun 16 08:47:17 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:17 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_9o5if0bpdevstack@QuobyteHD" returned: 0 in 0.855s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:17 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec was qcow2, converting to raw {{(pid=92348) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 16 08:47:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_9o5if0bpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:17 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_9o5if0bpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 Jun 16 08:47:17 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:20 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_9o5if0bpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0" returned: 0 in 2.354s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:20 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_9o5if0bpdevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:47:20 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Converted 112.00 MB image at 47.55 MB/s Jun 16 08:47:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:20 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 1G Jun 16 08:47:20 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:20 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 1G" returned: 0 in 0.766s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:20 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5517ae03-a045-4507-8ba4-637d0ac38910]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:21 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 Jun 16 08:47:21 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Flow 'volume_create_manager' (0d9b1e90-7d8b-4c7d-b44c-cd8d6a149b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bc18a1-4f81-4d57-a6d6-ace70035c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bc18a1-4f81-4d57-a6d6-ace70035c77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-169540243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ab255d-fd9a-44f7-8813-bad46a89c641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f1224ad9d94412aaa275c9ce7612a7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:47:21Z,use_quota=True,user_id='69ad10bbfde643f5a2b33700f9365e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f65c0a-f01e-4e5b-b7cb-92bf52dce544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f65c0a-f01e-4e5b-b7cb-92bf52dce544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0762c60-9786-45e4-90bd-ce4ec53eba27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0762c60-9786-45e4-90bd-ce4ec53eba27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50ab255d-fd9a-44f7-8813-bad46a89c641', 'volume_name': 'volume-50ab255d-fd9a-44f7-8813-bad46a89c641', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5dd256-04af-4715-a79f-55c81f244bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5dd256-04af-4715-a79f-55c81f244bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ad3360-7f46-4593-a31f-3dd2139897a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:21 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Volume 50ab255d-fd9a-44f7-8813-bad46a89c641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50ab255d-fd9a-44f7-8813-bad46a89c641', 'volume_size': 1} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-169540243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ab255d-fd9a-44f7-8813-bad46a89c641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f1224ad9d94412aaa275c9ce7612a7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:47:21Z,use_quota=True,user_id='69ad10bbfde643f5a2b33700f9365e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Creating volume 50ab255d-fd9a-44f7-8813-bad46a89c641 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:47:21 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-50ab255d-fd9a-44f7-8813-bad46a89c641 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:21 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-50ab255d-fd9a-44f7-8813-bad46a89c641 1073741824 Jun 16 08:47:21 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:21 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0" returned: 0 in 0.997s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:22 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 Jun 16 08:47:22 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:22 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-50ab255d-fd9a-44f7-8813-bad46a89c641 1073741824" returned: 0 in 0.946s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-50ab255d-fd9a-44f7-8813-bad46a89c641 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:22 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-50ab255d-fd9a-44f7-8813-bad46a89c641 Jun 16 08:47:22 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:22 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:47:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Flow 'volume_create_manager' (948b3152-a2c7-411e-82b5-884128a8aa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66688321-88ee-44a7-b92a-3b6638bb2f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66688321-88ee-44a7-b92a-3b6638bb2f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-709882118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3883b4-78fe-4107-94ec-8cb3d975c67c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7271e1b2ed3746d9a544224a244c7b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:47:23Z,use_quota=True,user_id='34b0f1b5196f41e8b225743b4ab8192d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7bf606-a02f-43ca-ab0a-741928d5c012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7bf606-a02f-43ca-ab0a-741928d5c012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f4f8f6-2f05-4d7c-920e-b9810b0c2f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:22 devstack cinder-volume[92348]: DEBUG cinder.image.glance [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Creating Keystone auth plugin from conf {{(pid=92348) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 16 08:47:22 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0" returned: 1 in 0.991s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:47:22 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Downloaded image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec ((None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}])) to volume d53b949b-cf35-4444-ac44-908efaedf9b0 successfully. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 16 08:47:22 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Temporary image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec for user 1ffc970e7a62422c9471a82991e75d0d is deleted. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 16 08:47:22 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Marking volume d53b949b-cf35-4444-ac44-908efaedf9b0 as bootable. {{(pid=92348) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 16 08:47:22 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Copying metadata from image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec to d53b949b-cf35-4444-ac44-908efaedf9b0. {{(pid=92348) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 16 08:47:22 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Creating volume glance metadata for volume d53b949b-cf35-4444-ac44-908efaedf9b0 backed by image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92348) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4063bb-39df-4a79-a20d-21e4a8e3506a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d53b949b-cf35-4444-ac44-908efaedf9b0', 'volume_size': 1, 'image_id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '038e50e6f4094f25b7da1abcd3989b23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'created_at': datetime.datetime(2026, 6, 16, 6, 33, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 34, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a676676a-d103-4185-a2d7-e21bcb1b5f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:23 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Volume volume-d53b949b-cf35-4444-ac44-908efaedf9b0 (d53b949b-cf35-4444-ac44-908efaedf9b0): created successfully Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a676676a-d103-4185-a2d7-e21bcb1b5f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Flow 'volume_create_manager' (a7d6f6b5-6360-489b-8051-6797656d108d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:23 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4149dc2e-9585-4000-b368-8e73befc74fe tempest-VolumesGetTest-1823628986 None] Created volume successfully. Jun 16 08:47:23 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f4f8f6-2f05-4d7c-920e-b9810b0c2f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be3883b4-78fe-4107-94ec-8cb3d975c67c', 'volume_name': 'volume-be3883b4-78fe-4107-94ec-8cb3d975c67c', 'volume_size': 1, 'image_id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '038e50e6f4094f25b7da1abcd3989b23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'created_at': datetime.datetime(2026, 6, 16, 6, 33, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 34, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61f8cd3-4fb8-4ecc-9c55-94a1e85a7710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61f8cd3-4fb8-4ecc-9c55-94a1e85a7710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8478a6-222b-4bf4-a148-5c1ad75fa1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:23 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Volume be3883b4-78fe-4107-94ec-8cb3d975c67c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be3883b4-78fe-4107-94ec-8cb3d975c67c', 'volume_size': 1, 'image_id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '038e50e6f4094f25b7da1abcd3989b23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'created_at': datetime.datetime(2026, 6, 16, 6, 33, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 34, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Trying to clone be3883b4-78fe-4107-94ec-8cb3d975c67c from image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}]). {{(pid=92348) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-50ab255d-fd9a-44f7-8813-bad46a89c641" returned: 0 in 0.799s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ad3360-7f46-4593-a31f-3dd2139897a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50ab255d-fd9a-44f7-8813-bad46a89c641', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b43d86-2ced-4c1f-8d1b-477c3bc8e806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:23 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Volume volume-50ab255d-fd9a-44f7-8813-bad46a89c641 (50ab255d-fd9a-44f7-8813-bad46a89c641): created successfully Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b43d86-2ced-4c1f-8d1b-477c3bc8e806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Flow 'volume_create_manager' (0d9b1e90-7d8b-4c7d-b44c-cd8d6a149b47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:23 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-d5e2f36d-34eb-431a-b8c8-70ee87df4b16 tempest-VolumesTransfersV357Test-1629799541 None] Created volume successfully. Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_avfkku2ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 16 08:47:23 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Image download 20.69 MB at 20.69 MB/s Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1216be7e-ec34-4076-821a-f3db4b103c84]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_avfkku2ndevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:23 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_avfkku2ndevstack@QuobyteHD Jun 16 08:47:23 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:24 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-f4957a2d-475f-41a4-93b9-daa91edb941e tempest-VolumesTransfersV357Test-399800902 None] Transfer volume completed successfully. Jun 16 08:47:24 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_avfkku2ndevstack@QuobyteHD" returned: 0 in 0.783s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:24 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Temporary image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec is fetched for user 34b0f1b5196f41e8b225743b4ab8192d. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 16 08:47:24 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b46306c-627b-44d0-a69d-7e93f95b37e3]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_avfkku2ndevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:24 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_avfkku2ndevstack@QuobyteHD Jun 16 08:47:24 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:24 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:47:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Flow 'volume_create_manager' (bcb83289-52c1-4e9e-a385-c40b9fd5678a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789e563a-e196-49a4-92d9-d481c4103d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789e563a-e196-49a4-92d9-d481c4103d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:47:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1456869693',display_name='tempest-VolumesGetTest-Volume-795841705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5faf2c-423b-4f90-a55c-1ed8beaee3ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebbc2b5cb34a769a2656b2b77de361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:47:25Z,use_quota=True,user_id='1ffc970e7a62422c9471a82991e75d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c99f1ba-ca5b-44d5-92ae-720a3b177294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c99f1ba-ca5b-44d5-92ae-720a3b177294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e1aea0-be80-4e07-a60b-3e5e8c726951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e1aea0-be80-4e07-a60b-3e5e8c726951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd5faf2c-423b-4f90-a55c-1ed8beaee3ef', 'volume_name': 'volume-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3ef253-cd7f-4dc6-96ee-32b89a13026d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3ef253-cd7f-4dc6-96ee-32b89a13026d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2a95cf-08b7-4bb4-b4b8-e0d6d99e8670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:25 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Volume dd5faf2c-423b-4f90-a55c-1ed8beaee3ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef', 'volume_size': 1} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:47:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1456869693',display_name='tempest-VolumesGetTest-Volume-795841705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5faf2c-423b-4f90-a55c-1ed8beaee3ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebbc2b5cb34a769a2656b2b77de361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:47:25Z,use_quota=True,user_id='1ffc970e7a62422c9471a82991e75d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Creating volume dd5faf2c-423b-4f90-a55c-1ed8beaee3ef {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:47:25 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:25 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef 1073741824 Jun 16 08:47:25 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:25 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_avfkku2ndevstack@QuobyteHD" returned: 0 in 0.829s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] Acquiring lock "cinder-50ab255d-fd9a-44f7-8813-bad46a89c641-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] Lock "cinder-50ab255d-fd9a-44f7-8813-bad46a89c641-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] Acquiring lock "cinder-quobyte-50ab255d-fd9a-44f7-8813-bad46a89c641" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] Lock "cinder-quobyte-50ab255d-fd9a-44f7-8813-bad46a89c641" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6311076-ca21-46e4-ae7d-73c351f8b0a7]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-50ab255d-fd9a-44f7-8813-bad46a89c641 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:25 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-50ab255d-fd9a-44f7-8813-bad46a89c641 Jun 16 08:47:25 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:25 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef 1073741824" returned: 0 in 0.838s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:25 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef Jun 16 08:47:25 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:26 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-50ab255d-fd9a-44f7-8813-bad46a89c641" returned: 0 in 0.799s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-50ab255d-fd9a-44f7-8813-bad46a89c641 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:26 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-50ab255d-fd9a-44f7-8813-bad46a89c641 Jun 16 08:47:26 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:26 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef" returned: 0 in 0.624s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.193s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-709882118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3883b4-78fe-4107-94ec-8cb3d975c67c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7271e1b2ed3746d9a544224a244c7b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:47:23Z,use_quota=True,user_id='34b0f1b5196f41e8b225743b4ab8192d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Creating volume be3883b4-78fe-4107-94ec-8cb3d975c67c {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:47:26 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2a95cf-08b7-4bb4-b4b8-e0d6d99e8670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a447db-4538-4d01-8a3d-7e05c74f42da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:26 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c 1073741824 Jun 16 08:47:26 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:26 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Volume volume-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef (dd5faf2c-423b-4f90-a55c-1ed8beaee3ef): created successfully Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a447db-4538-4d01-8a3d-7e05c74f42da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Flow 'volume_create_manager' (bcb83289-52c1-4e9e-a385-c40b9fd5678a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:26 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-5b71d75a-700d-4c34-bc16-e0883f552470 tempest-VolumesGetTest-1823628986 None] Created volume successfully. Jun 16 08:47:27 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-50ab255d-fd9a-44f7-8813-bad46a89c641" returned: 0 in 0.652s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] Lock "cinder-quobyte-50ab255d-fd9a-44f7-8813-bad46a89c641" released by "delete_volume" :: held 1.530s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:27 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] Created reservations ['48993e12-59f4-435c-a261-8c64352ed404', '9b0f7268-5ab6-4b97-ad9c-2c3ddc3c30e5', 'daf87762-40f9-4544-bb08-807aa0178b3b', 'c6dcc2e4-f566-491f-b20b-f742c98bc2f1'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:47:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] Acquiring lock "cinder-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] Lock "cinder-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] Acquiring lock "cinder-quobyte-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:27 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:47:27 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef" acquired by "delete_volume" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:27 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9365c2-008d-4fe6-9173-8388208cab47]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:27 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef Jun 16 08:47:27 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:27 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c 1073741824" returned: 0 in 1.017s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:27 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c Jun 16 08:47:27 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:28 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.167s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:47:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] Deleted volume successfully. Jun 16 08:47:28 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef" returned: 0 in 1.130s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8bd5ad43-aad0-424e-838b-d8974678614f tempest-VolumesTransfersV357Test-1713363348 None] Lock "cinder-50ab255d-fd9a-44f7-8813-bad46a89c641-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:28 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef Jun 16 08:47:28 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Flow 'volume_create_manager' (859fa37e-7b0e-4dbd-a32c-fc90bd8df439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2455573b-3027-4889-84b0-f647f06a668f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:28 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c" returned: 0 in 1.038s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2455573b-3027-4889-84b0-f647f06a668f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1773258835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8713804f-7512-42ea-9a33-1076e87ca9c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f1224ad9d94412aaa275c9ce7612a7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:47:29Z,use_quota=True,user_id='69ad10bbfde643f5a2b33700f9365e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b94b2d-8406-49ef-a057-4be62ea1c700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b94b2d-8406-49ef-a057-4be62ea1c700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04dccd4c-de5a-4135-8847-96796de047b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04dccd4c-de5a-4135-8847-96796de047b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8713804f-7512-42ea-9a33-1076e87ca9c7', 'volume_name': 'volume-8713804f-7512-42ea-9a33-1076e87ca9c7', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb2a30a-81cb-4bde-9536-8ffbba854b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb2a30a-81cb-4bde-9536-8ffbba854b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a93287-7142-4b22-8fd7-77663a64494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:28 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Volume 8713804f-7512-42ea-9a33-1076e87ca9c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8713804f-7512-42ea-9a33-1076e87ca9c7', 'volume_size': 1} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1773258835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8713804f-7512-42ea-9a33-1076e87ca9c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f1224ad9d94412aaa275c9ce7612a7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:47:29Z,use_quota=True,user_id='69ad10bbfde643f5a2b33700f9365e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Creating volume 8713804f-7512-42ea-9a33-1076e87ca9c7 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:47:28 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8713804f-7512-42ea-9a33-1076e87ca9c7 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:28 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8713804f-7512-42ea-9a33-1076e87ca9c7 1073741824 Jun 16 08:47:28 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Attempting download of 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec ((None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}])) to volume be3883b4-78fe-4107-94ec-8cb3d975c67c. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be41af6-a128-4080-b684-d75a54a372b4]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_fk50g_uh {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:29 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_fk50g_uh Jun 16 08:47:29 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:29 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef" returned: 0 in 0.716s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef" released by "delete_volume" :: held 1.895s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] Created reservations ['dcd3cbda-ca06-42a3-96a9-76307e95c25c', 'b2c0b386-9a6c-4969-9b6d-7cb1b28ffb62', '368f62c4-5c9d-45c6-817c-07bbd3dbcdd0', 'f991db55-ae65-4db7-a8ee-28e1069685ab'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:29 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:47:29 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Acquiring lock "cinder-d53b949b-cf35-4444-ac44-908efaedf9b0-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Lock "cinder-d53b949b-cf35-4444-ac44-908efaedf9b0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Acquiring lock "cinder-quobyte-d53b949b-cf35-4444-ac44-908efaedf9b0" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-d53b949b-cf35-4444-ac44-908efaedf9b0" acquired by "delete_volume" :: waited 0.037s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2211154-5fd6-4444-9711-ea7556c71f4c]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:29 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8713804f-7512-42ea-9a33-1076e87ca9c7 1073741824" returned: 0 in 1.137s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8713804f-7512-42ea-9a33-1076e87ca9c7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:29 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8713804f-7512-42ea-9a33-1076e87ca9c7 Jun 16 08:47:29 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:29 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_fk50g_uh" returned: 0 in 1.061s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_fk50g_uh {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:29 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 Jun 16 08:47:29 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:30 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_fk50g_uh Jun 16 08:47:30 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:30 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:47:30 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:30 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.255s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:47:30 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] Deleted volume successfully. Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-042fcabd-dcc5-4959-ab68-79a14f8d6edb tempest-VolumesGetTest-1823628986 None] Lock "cinder-dd5faf2c-423b-4f90-a55c-1ed8beaee3ef-delete_volume" released by "delete_volume" :: held 3.481s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:30 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_fk50g_uh" returned: 1 in 0.854s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_fk50g_uh' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ba2b53-4e83-4366-bf29-e4db4c279a89]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_avfkku2ndevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:30 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8713804f-7512-42ea-9a33-1076e87ca9c7" returned: 0 in 0.996s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.199s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a93287-7142-4b22-8fd7-77663a64494c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8713804f-7512-42ea-9a33-1076e87ca9c7', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e3f043-fa72-42aa-84e7-eef6b0a6842a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:30 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Volume volume-8713804f-7512-42ea-9a33-1076e87ca9c7 (8713804f-7512-42ea-9a33-1076e87ca9c7): created successfully Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e3f043-fa72-42aa-84e7-eef6b0a6842a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Flow 'volume_create_manager' (859fa37e-7b0e-4dbd-a32c-fc90bd8df439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:30 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_avfkku2ndevstack@QuobyteHD Jun 16 08:47:31 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:31 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ca92b29f-329f-451b-b27f-d94c7acdc0fd tempest-VolumesTransfersV357Test-1629799541 None] Created volume successfully. Jun 16 08:47:31 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0" returned: 0 in 1.236s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:31 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 Jun 16 08:47:31 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:31 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.120s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:31 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:47:31 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:47:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:47:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:47:31 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_avfkku2ndevstack@QuobyteHD" returned: 0 in 0.870s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:31 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec was qcow2, converting to raw {{(pid=92348) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 16 08:47:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_avfkku2ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:31 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_avfkku2ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c Jun 16 08:47:31 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:31 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0" returned: 1 in 0.811s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:47:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:31 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0 Jun 16 08:47:31 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] Acquiring lock "cinder-8713804f-7512-42ea-9a33-1076e87ca9c7-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] Lock "cinder-8713804f-7512-42ea-9a33-1076e87ca9c7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] Acquiring lock "cinder-quobyte-8713804f-7512-42ea-9a33-1076e87ca9c7" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] Lock "cinder-quobyte-8713804f-7512-42ea-9a33-1076e87ca9c7" acquired by "delete_volume" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:32 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ae3893-9611-4720-8a94-da0a4ef0687c]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8713804f-7512-42ea-9a33-1076e87ca9c7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:32 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d53b949b-cf35-4444-ac44-908efaedf9b0" returned: 0 in 0.669s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Lock "cinder-quobyte-d53b949b-cf35-4444-ac44-908efaedf9b0" released by "delete_volume" :: held 2.814s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:32 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Created reservations ['dadebb05-7834-4931-a295-e6c289b71f56', 'b5d30d8c-a61b-4406-a2d8-589837c61fe6', '5bf70d59-ebd3-44bd-8703-c64cde78d768', 'cbacebd5-0bf8-45ac-8786-81f24cb5afc7'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:47:32 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8713804f-7512-42ea-9a33-1076e87ca9c7 Jun 16 08:47:32 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:32 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:47:32 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:33 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8713804f-7512-42ea-9a33-1076e87ca9c7" returned: 0 in 1.024s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8713804f-7512-42ea-9a33-1076e87ca9c7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:33 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8713804f-7512-42ea-9a33-1076e87ca9c7 Jun 16 08:47:33 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:33 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.092s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:33 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:47:33 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Deleted volume successfully. Jun 16 08:47:33 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cf71a102-0de0-413f-b524-892b55ad5ac3 tempest-VolumesGetTest-1823628986 None] Lock "cinder-d53b949b-cf35-4444-ac44-908efaedf9b0-delete_volume" released by "delete_volume" :: held 4.231s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:34 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_avfkku2ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c" returned: 0 in 2.522s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:34 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_avfkku2ndevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:47:34 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Converted 112.00 MB image at 44.40 MB/s Jun 16 08:47:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:34 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c 1G Jun 16 08:47:34 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:34 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8713804f-7512-42ea-9a33-1076e87ca9c7" returned: 0 in 0.867s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:34 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] Lock "cinder-quobyte-8713804f-7512-42ea-9a33-1076e87ca9c7" released by "delete_volume" :: held 1.954s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:34 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] Created reservations ['f0cde6de-50ba-48b6-ab25-666cd739b071', '47337f83-ad49-413a-85d7-3e6751e13b32', '39efb513-639f-4c0c-9746-60119203c13a', '4e13345f-d10f-4966-bf7b-beb275764c90'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:47:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:34 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:47:34 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:35 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c 1G" returned: 0 in 1.331s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:35 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6f0854-c976-434b-bab0-9c56d1fd6d18]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:35 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.986s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:35 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:47:35 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] Deleted volume successfully. Jun 16 08:47:35 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c1658aa4-465f-41d6-b589-c979c51b05e1 tempest-VolumesTransfersV357Test-1713363348 None] Lock "cinder-8713804f-7512-42ea-9a33-1076e87ca9c7-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:35 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c Jun 16 08:47:35 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:36 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c" returned: 0 in 0.818s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:36 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c Jun 16 08:47:36 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:37 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c" returned: 1 in 0.810s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Downloaded image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec ((None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}])) to volume be3883b4-78fe-4107-94ec-8cb3d975c67c successfully. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Temporary image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec for user 34b0f1b5196f41e8b225743b4ab8192d is deleted. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Marking volume be3883b4-78fe-4107-94ec-8cb3d975c67c as bootable. {{(pid=92348) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Copying metadata from image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec to be3883b4-78fe-4107-94ec-8cb3d975c67c. {{(pid=92348) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Creating volume glance metadata for volume be3883b4-78fe-4107-94ec-8cb3d975c67c backed by image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92348) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8478a6-222b-4bf4-a148-5c1ad75fa1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be3883b4-78fe-4107-94ec-8cb3d975c67c', 'volume_size': 1, 'image_id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '038e50e6f4094f25b7da1abcd3989b23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'created_at': datetime.datetime(2026, 6, 16, 6, 33, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 34, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d401ed71-2461-47b0-80f3-fd8fece2c323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:37 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Volume volume-be3883b4-78fe-4107-94ec-8cb3d975c67c (be3883b4-78fe-4107-94ec-8cb3d975c67c): created successfully Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d401ed71-2461-47b0-80f3-fd8fece2c323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Flow 'volume_create_manager' (948b3152-a2c7-411e-82b5-884128a8aa61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:37 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-adbc0828-eb93-4127-8934-6c50b0781a6d tempest-VolumesImageMetadata-919233178 None] Created volume successfully. Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Flow 'volume_create_manager' (d344aabf-cbbd-46b3-9a47-389c10cc12b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62ba155-5335-4333-baf7-f6e0c7edf938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62ba155-5335-4333-baf7-f6e0c7edf938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-235949174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5b650a-6e03-4d00-b506-4df9ad40c179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d273e865954624ad45aeb9bded56d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:47:38Z,use_quota=True,user_id='6dc1e208b51c4484aad08ffe1df00d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c63d347-0877-4817-b9e3-ae4053d5a922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c63d347-0877-4817-b9e3-ae4053d5a922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5403398d-2a38-4835-b2a4-cdc62114b07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5403398d-2a38-4835-b2a4-cdc62114b07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e5b650a-6e03-4d00-b506-4df9ad40c179', 'volume_name': 'volume-6e5b650a-6e03-4d00-b506-4df9ad40c179', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe701464-829f-4768-931a-7e97fbf1a08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe701464-829f-4768-931a-7e97fbf1a08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806d7095-4e7c-4051-bc98-9aeb3f247623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:37 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Volume 6e5b650a-6e03-4d00-b506-4df9ad40c179: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e5b650a-6e03-4d00-b506-4df9ad40c179', 'volume_size': 1} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-235949174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5b650a-6e03-4d00-b506-4df9ad40c179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d273e865954624ad45aeb9bded56d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:47:38Z,use_quota=True,user_id='6dc1e208b51c4484aad08ffe1df00d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Creating volume 6e5b650a-6e03-4d00-b506-4df9ad40c179 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:47:37 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:47:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:38 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179 1073741824 Jun 16 08:47:38 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Acquiring lock "cinder-be3883b4-78fe-4107-94ec-8cb3d975c67c-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Lock "cinder-be3883b4-78fe-4107-94ec-8cb3d975c67c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Acquiring lock "cinder-quobyte-be3883b4-78fe-4107-94ec-8cb3d975c67c" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Lock "cinder-quobyte-be3883b4-78fe-4107-94ec-8cb3d975c67c" acquired by "delete_volume" :: waited 0.030s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:38 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfb050d-244e-4208-a558-05d0f35cc6ba]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:38 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179 1073741824" returned: 0 in 0.986s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:39 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c Jun 16 08:47:39 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:39 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179 Jun 16 08:47:39 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:39 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c" returned: 0 in 0.831s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:39 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179" returned: 0 in 0.732s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:47:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806d7095-4e7c-4051-bc98-9aeb3f247623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e5b650a-6e03-4d00-b506-4df9ad40c179', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eba6437-093a-481b-be75-538e6b16dbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:39 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Volume volume-6e5b650a-6e03-4d00-b506-4df9ad40c179 (6e5b650a-6e03-4d00-b506-4df9ad40c179): created successfully Jun 16 08:47:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eba6437-093a-481b-be75-538e6b16dbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Flow 'volume_create_manager' (d344aabf-cbbd-46b3-9a47-389c10cc12b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:39 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-bad1d743-60ff-4ef0-8293-52515e8958de tempest-VolumesSnapshotListTestJSON-1185929747 None] Created volume successfully. Jun 16 08:47:39 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c Jun 16 08:47:39 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] Creating offline snapshot b5cdb866-7a7b-4faf-a633-a734f104c900 of volume 6e5b650a-6e03-4d00-b506-4df9ad40c179 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:47:40 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4ea6a8-0d18-4bd1-98ce-f0ac895beccd]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:40 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179 Jun 16 08:47:40 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:40 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c" returned: 1 in 1.048s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:47:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:40 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c Jun 16 08:47:40 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:41 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179" returned: 0 in 0.924s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:41 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 1G Jun 16 08:47:41 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:41 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-be3883b4-78fe-4107-94ec-8cb3d975c67c" returned: 0 in 0.829s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Lock "cinder-quobyte-be3883b4-78fe-4107-94ec-8cb3d975c67c" released by "delete_volume" :: held 2.818s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Created reservations ['0bce48bc-b327-49d7-ad02-fcb6e8f7c9fa', '1f92e561-bd3f-475d-bdd6-b47727357a6e', '902ffcf6-9233-4e49-92cc-6de0fb3844de', '6af0612f-0e7b-4753-b2fe-70a288942e9d'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:41 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:47:41 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Flow 'volume_create_manager' (ae8a2147-a878-448a-a229-62f01cfa2cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c90bd2-cd60-4f04-9cb6-c294887c7e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c90bd2-cd60-4f04-9cb6-c294887c7e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-714565554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b72e45-175a-4339-953d-41cb3ed18f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd0e7568ea456ea8671051351ace9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:47:42Z,use_quota=True,user_id='fff0ad879afb45f09c34644282d98b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45278cfc-3307-43be-bcfb-19545531dd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45278cfc-3307-43be-bcfb-19545531dd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ba32cb-5a0b-4ab0-9228-02daf7f3c5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ba32cb-5a0b-4ab0-9228-02daf7f3c5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b72e45-175a-4339-953d-41cb3ed18f41', 'volume_name': 'volume-66b72e45-175a-4339-953d-41cb3ed18f41', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71da8ee-e3f1-4f75-80e2-1453e23374af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71da8ee-e3f1-4f75-80e2-1453e23374af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f1193d-1f81-4463-8829-228aebee0a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:42 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Volume 66b72e45-175a-4339-953d-41cb3ed18f41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b72e45-175a-4339-953d-41cb3ed18f41', 'volume_size': 1} Jun 16 08:47:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:42 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 1G" returned: 0 in 0.972s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e5b650a-6e03-4d00-b506-4df9ad40c179 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:42 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e5b650a-6e03-4d00-b506-4df9ad40c179 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 Jun 16 08:47:42 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:42 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.682s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:42 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:47:42 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Deleted volume successfully. Jun 16 08:47:42 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=110,cinder:UPDATE=156,cinder:INSERT=45,cinder:DELETE=9 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:47:42 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8aaa41e6-12a3-44c7-8b50-eddf5c3b5522 tempest-VolumesImageMetadata-919233178 None] Lock "cinder-be3883b4-78fe-4107-94ec-8cb3d975c67c-delete_volume" released by "delete_volume" :: held 3.792s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:47:43 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e5b650a-6e03-4d00-b506-4df9ad40c179 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900" returned: 0 in 0.726s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:43 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 is being set with open permissions: ugo+rw Jun 16 08:47:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:43 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 Jun 16 08:47:43 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:43 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900" returned: 0 in 0.601s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:43 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.info Jun 16 08:47:43 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:44 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.info" returned: 0 in 0.611s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:44 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.info is being set with open permissions: ugo+rw Jun 16 08:47:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:44 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.info Jun 16 08:47:44 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:44 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.info" returned: 0 in 0.699s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.631s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.974s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-714565554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b72e45-175a-4339-953d-41cb3ed18f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd0e7568ea456ea8671051351ace9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:47:42Z,use_quota=True,user_id='fff0ad879afb45f09c34644282d98b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:47:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Creating volume 66b72e45-175a-4339-953d-41cb3ed18f41 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:47:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:47:44 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:47:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:45 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 1073741824 Jun 16 08:47:45 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:45 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ab945cbd-dba3-41ae-9fbf-554737e803cf tempest-VolumesSnapshotListTestJSON-1185929747 None] Create snapshot completed successfully Jun 16 08:47:45 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:47:45 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Flow 'volume_create_manager' (c34e227d-5b7a-450f-b6f1-c23149908df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:45 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9934735c-93eb-4f13-bb52-4d01a8ae23d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:45 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9934735c-93eb-4f13-bb52-4d01a8ae23d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-436807373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb518087403437a9d131d7561266de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:47:45Z,use_quota=True,user_id='0e073dd50a5741ac93db5abb7d8aa8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:45 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45deba4-1fab-40a9-935a-eb64a530f23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:45 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45deba4-1fab-40a9-935a-eb64a530f23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:45 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3719f6ce-6d21-4dbc-9425-491ca133f739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:45 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3719f6ce-6d21-4dbc-9425-491ca133f739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3', 'volume_name': 'volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:45 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb57a68-210f-4c11-8eab-96d7c147d18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:45 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb57a68-210f-4c11-8eab-96d7c147d18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:45 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1e5c33-302c-49f8-baad-5469547fc808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:45 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Volume b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3', 'volume_size': 1} Jun 16 08:47:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-45f09a51-2f89-4d2e-9b28-bca1e91b4e27 tempest-VolumesSnapshotListTestJSON-1185929747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:45 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 1073741824" returned: 0 in 1.005s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:46 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 Jun 16 08:47:46 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:46 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41" returned: 0 in 0.639s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.468s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-436807373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb518087403437a9d131d7561266de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:47:45Z,use_quota=True,user_id='0e073dd50a5741ac93db5abb7d8aa8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Creating volume b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:47:46 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:46 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 1073741824 Jun 16 08:47:46 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f1193d-1f81-4463-8829-228aebee0a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b72e45-175a-4339-953d-41cb3ed18f41', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0b1b6b-684c-4f6d-9829-861662bd10ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:46 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Volume volume-66b72e45-175a-4339-953d-41cb3ed18f41 (66b72e45-175a-4339-953d-41cb3ed18f41): created successfully Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0b1b6b-684c-4f6d-9829-861662bd10ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Flow 'volume_create_manager' (ae8a2147-a878-448a-a229-62f01cfa2cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:46 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-3ab0be64-5b8e-41b9-9d0b-71ed15691f97 tempest-VolumesCloneTest-1717242219 None] Created volume successfully. Jun 16 08:47:47 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 1073741824" returned: 0 in 0.874s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:47 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 Jun 16 08:47:47 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:47 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:47:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Flow 'volume_create_manager' (6ee68f7d-5591-4b2d-b192-d677eecc8758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa8694c-08e0-43ed-a533-29bda3b55978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa8694c-08e0-43ed-a533-29bda3b55978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2089012730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e81f56-43ac-4677-9912-633ee751ae76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4cd0e7568ea456ea8671051351ace9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:47:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=66b72e45-175a-4339-953d-41cb3ed18f41,status='creating',terminated_at=None,updated_at=2026-06-16T06:47:48Z,use_quota=True,user_id='fff0ad879afb45f09c34644282d98b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1876b230-2682-4018-9e21-dd448da70c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1876b230-2682-4018-9e21-dd448da70c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e0aef6-1c38-4d4a-ab90-ffb344447e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e0aef6-1c38-4d4a-ab90-ffb344447e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a1e81f56-43ac-4677-9912-633ee751ae76', 'volume_name': 'volume-a1e81f56-43ac-4677-9912-633ee751ae76', 'volume_size': 2, 'source_volid': '66b72e45-175a-4339-953d-41cb3ed18f41', 'source_volstatus': 'available'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b389d5e-d768-4276-8c30-e611ca393adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b389d5e-d768-4276-8c30-e611ca393adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e489e7e3-4236-4711-a31b-70662c67d7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:47 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Volume a1e81f56-43ac-4677-9912-633ee751ae76: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a1e81f56-43ac-4677-9912-633ee751ae76', 'volume_size': 2, 'source_volid': '66b72e45-175a-4339-953d-41cb3ed18f41', 'source_volstatus': 'available'} Jun 16 08:47:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:48 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3" returned: 0 in 0.604s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:47:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-45f09a51-2f89-4d2e-9b28-bca1e91b4e27 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.375s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1e5c33-302c-49f8-baad-5469547fc808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba7e2f26-7605-4ef4-9544-b7ec09b32e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:47:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-45f09a51-2f89-4d2e-9b28-bca1e91b4e27 tempest-VolumesSnapshotListTestJSON-1185929747 None] Creating offline snapshot 0fb2f3b2-2adb-4780-82b2-5f19d8249743 of volume 6e5b650a-6e03-4d00-b506-4df9ad40c179 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:47:48 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Volume volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 (b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3): created successfully Jun 16 08:47:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba7e2f26-7605-4ef4-9544-b7ec09b32e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:47:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Flow 'volume_create_manager' (c34e227d-5b7a-450f-b6f1-c23149908df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:47:48 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[758b2726-ec0a-476d-a1d0-75b8cd77b80d]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-45f09a51-2f89-4d2e-9b28-bca1e91b4e27 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:48 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-84a52e33-3a61-413d-bbe8-49cca5b38154 tempest-VolumesDeleteCascade-200718758 None] Created volume successfully. Jun 16 08:47:48 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 Jun 16 08:47:48 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:49 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-45f09a51-2f89-4d2e-9b28-bca1e91b4e27 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900" returned: 0 in 0.742s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-45f09a51-2f89-4d2e-9b28-bca1e91b4e27 tempest-VolumesSnapshotListTestJSON-1185929747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e5b650a-6e03-4d00-b506-4df9ad40c179(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:47:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-45f09a51-2f89-4d2e-9b28-bca1e91b4e27 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:49 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 1G Jun 16 08:47:49 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:49 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-45f09a51-2f89-4d2e-9b28-bca1e91b4e27 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 1G" returned: 0 in 0.789s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-45f09a51-2f89-4d2e-9b28-bca1e91b4e27 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:49 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 Jun 16 08:47:49 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:50 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-45f09a51-2f89-4d2e-9b28-bca1e91b4e27 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743" returned: 0 in 0.623s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:50 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-45f09a51-2f89-4d2e-9b28-bca1e91b4e27 tempest-VolumesSnapshotListTestJSON-1185929747 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 is being set with open permissions: ugo+rw Jun 16 08:47:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-45f09a51-2f89-4d2e-9b28-bca1e91b4e27 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:50 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 Jun 16 08:47:50 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:51 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-45f09a51-2f89-4d2e-9b28-bca1e91b4e27 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743" returned: 0 in 0.598s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-45f09a51-2f89-4d2e-9b28-bca1e91b4e27 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.854s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.199s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:51 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Cloning volume 66b72e45-175a-4339-953d-41cb3ed18f41 to volume a1e81f56-43ac-4677-9912-633ee751ae76 Jun 16 08:47:51 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-45f09a51-2f89-4d2e-9b28-bca1e91b4e27 tempest-VolumesSnapshotListTestJSON-1185929747 None] Create snapshot completed successfully Jun 16 08:47:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Creating offline snapshot 26b49401-c1f7-4909-b305-c53bd95b374e of volume 66b72e45-175a-4339-953d-41cb3ed18f41 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:47:51 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7168b319-00ef-4ae0-8d0f-0c26e4c5b340]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:51 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 Jun 16 08:47:51 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:51 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41" returned: 0 in 0.838s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:52 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e 1G Jun 16 08:47:52 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:52 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:UPDATE=139,cinder:SELECT=126,cinder:DELETE=15,cinder:INSERT=48 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:47:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9aee888c-4aea-414e-9bcf-2d7b91ef15f4 tempest-VolumesSnapshotListTestJSON-1185929747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:53 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e 1G" returned: 0 in 1.155s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b72e45-175a-4339-953d-41cb3ed18f41 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:53 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b72e45-175a-4339-953d-41cb3ed18f41 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e Jun 16 08:47:53 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:53 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b72e45-175a-4339-953d-41cb3ed18f41 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e" returned: 0 in 0.738s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:53 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e is being set with open permissions: ugo+rw Jun 16 08:47:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:53 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e Jun 16 08:47:53 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:54 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e" returned: 0 in 0.659s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:54 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.info Jun 16 08:47:54 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:55 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.info" returned: 0 in 0.844s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:55 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.info is being set with open permissions: ugo+rw Jun 16 08:47:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:55 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.info Jun 16 08:47:55 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:56 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.info" returned: 0 in 0.636s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Acquiring lock "cinder-quobyte-a1e81f56-43ac-4677-9912-633ee751ae76" by "_copy_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:47:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Lock "cinder-quobyte-a1e81f56-43ac-4677-9912-633ee751ae76" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:47:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] snapshot: 26b49401-c1f7-4909-b305-c53bd95b374e, volume: a1e81f56-43ac-4677-9912-633ee751ae76, {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 16 08:47:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:47:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:47:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:47:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:47:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:47:56 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[30deaef6-6021-4458-8845-fb59468b89c4]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:56 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e Jun 16 08:47:56 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:56 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e" returned: 0 in 0.840s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66b72e45-175a-4339-953d-41cb3ed18f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:47:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 16 08:47:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Creating direct copy from snapshot {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 16 08:47:56 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6f953b-1dea-4bfd-8a01-ccb4eae99363]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:47:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:57 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 Jun 16 08:47:57 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:47:57 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Jun 16 08:47:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41" returned: 0 in 0.740s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:47:57 devstack cinder-volume[92348]: DEBUG cinder.utils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Path /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a1e81f56-43ac-4677-9912-633ee751ae76 not found in is_blk_device check {{(pid=92348) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 16 08:47:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a1e81f56-43ac-4677-9912-633ee751ae76 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:47:57 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a1e81f56-43ac-4677-9912-633ee751ae76 Jun 16 08:47:57 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:03 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a1e81f56-43ac-4677-9912-633ee751ae76" returned: 0 in 5.741s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:03 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6836aba0-356d-46fb-86c6-12b2dde276ca]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:03 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 Jun 16 08:48:03 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:04 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41" returned: 0 in 0.907s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:04 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a1e81f56-43ac-4677-9912-633ee751ae76 {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:48:04 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Converted 1024.00 MB image at 178.29 MB/s Jun 16 08:48:04 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a1e81f56-43ac-4677-9912-633ee751ae76 is being set with open permissions: ugo+rw Jun 16 08:48:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a1e81f56-43ac-4677-9912-633ee751ae76 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:04 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a1e81f56-43ac-4677-9912-633ee751ae76 Jun 16 08:48:04 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:04 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=12,cinder:UPDATE=8,cinder:DELETE=3 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:48:04 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1,cinder:INSERT=1 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:48:04 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a1e81f56-43ac-4677-9912-633ee751ae76" returned: 0 in 0.594s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:04 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Lock "cinder-quobyte-a1e81f56-43ac-4677-9912-633ee751ae76" released by "_copy_volume_from_snapshot" :: held 8.911s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Acquiring lock "cinder-quobyte-26b49401-c1f7-4909-b305-c53bd95b374e" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Lock "cinder-quobyte-26b49401-c1f7-4909-b305-c53bd95b374e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Deleting offline snapshot 26b49401-c1f7-4909-b305-c53bd95b374e of volume 66b72e45-175a-4339-953d-41cb3ed18f41 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:48:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] snapshot_file for this snap is: volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:48:05 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e5d8ae-4a0b-49c0-a96c-586872952900]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:05 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e Jun 16 08:48:05 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:05 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e" returned: 0 in 0.735s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66b72e45-175a-4339-953d-41cb3ed18f41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:48:05 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a16a343-9c9e-4884-b6fb-e415abf08c52]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:05 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 Jun 16 08:48:05 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:06 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41" returned: 0 in 0.704s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:06 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e Jun 16 08:48:06 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:07 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e" returned: 0 in 0.654s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:07 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e Jun 16 08:48:07 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:07 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41.26b49401-c1f7-4909-b305-c53bd95b374e" returned: 0 in 0.586s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Lock "cinder-quobyte-26b49401-c1f7-4909-b305-c53bd95b374e" released by "_delete_snapshot" :: held 2.773s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.774s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 18.309s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] Creating offline snapshot 901e1e82-7e15-41a0-bdc6-e61258a8b47e of volume b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:48:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e489e7e3-4236-4711-a31b-70662c67d7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e81f56-43ac-4677-9912-633ee751ae76', 'volume_size': 2, 'source_volid': '66b72e45-175a-4339-953d-41cb3ed18f41', 'source_volstatus': 'available'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b590a6-c999-42c5-b4ce-af2a71d18388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:07 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7697be-65d7-42c9-8ea7-217f65bb4558]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:07 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Volume volume-a1e81f56-43ac-4677-9912-633ee751ae76 (a1e81f56-43ac-4677-9912-633ee751ae76): created successfully Jun 16 08:48:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b590a6-c999-42c5-b4ce-af2a71d18388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Flow 'volume_create_manager' (6ee68f7d-5591-4b2d-b192-d677eecc8758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:48:07 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-9d066112-e340-444e-8c49-8ed9d169ab8d tempest-VolumesCloneTest-1717242219 None] Created volume successfully. Jun 16 08:48:07 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 Jun 16 08:48:07 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:08 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3" returned: 0 in 0.691s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:08 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e 1G Jun 16 08:48:08 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:08 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] Acquiring lock "cinder-a1e81f56-43ac-4677-9912-633ee751ae76-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:08 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] Lock "cinder-a1e81f56-43ac-4677-9912-633ee751ae76-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:08 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] Acquiring lock "cinder-quobyte-a1e81f56-43ac-4677-9912-633ee751ae76" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:08 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] Lock "cinder-quobyte-a1e81f56-43ac-4677-9912-633ee751ae76" acquired by "delete_volume" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:08 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c74805-6369-45c6-b01a-99690c4361fe]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a1e81f56-43ac-4677-9912-633ee751ae76 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:09 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a1e81f56-43ac-4677-9912-633ee751ae76 Jun 16 08:48:09 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:09 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e 1G" returned: 0 in 0.732s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:09 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e Jun 16 08:48:09 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:09 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a1e81f56-43ac-4677-9912-633ee751ae76" returned: 0 in 0.720s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a1e81f56-43ac-4677-9912-633ee751ae76 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:09 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a1e81f56-43ac-4677-9912-633ee751ae76 Jun 16 08:48:09 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:09 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e" returned: 0 in 0.619s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:09 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e is being set with open permissions: ugo+rw Jun 16 08:48:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:09 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e Jun 16 08:48:09 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:10 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a1e81f56-43ac-4677-9912-633ee751ae76" returned: 0 in 0.590s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:10 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] Lock "cinder-quobyte-a1e81f56-43ac-4677-9912-633ee751ae76" released by "delete_volume" :: held 1.350s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:10 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] Created reservations ['2a129d4e-e210-498a-be5d-c090a1e5176d', '8ec2eb5a-7200-4510-8727-f8cb0d114695', '553baa89-cb5b-42a7-b0c0-030497b8a522', '9321d926-1d89-49f7-861b-dde9985a823e'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:48:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:10 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:48:10 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:48:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:10 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:48:10 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:10 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e" returned: 0 in 0.588s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:10 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.info Jun 16 08:48:10 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:10 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.646s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:10 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:48:10 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] Deleted volume successfully. Jun 16 08:48:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-21bb1def-7e6d-4783-8cca-a9ac4266117f tempest-VolumesCloneTest-1717242219 None] Lock "cinder-a1e81f56-43ac-4677-9912-633ee751ae76-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] Acquiring lock "cinder-66b72e45-175a-4339-953d-41cb3ed18f41-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] Lock "cinder-66b72e45-175a-4339-953d-41cb3ed18f41-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:11 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.info" returned: 0 in 0.582s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:11 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.info is being set with open permissions: ugo+rw Jun 16 08:48:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:11 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.info Jun 16 08:48:11 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] Acquiring lock "cinder-quobyte-66b72e45-175a-4339-953d-41cb3ed18f41" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] Lock "cinder-quobyte-66b72e45-175a-4339-953d-41cb3ed18f41" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:11 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f015f403-f775-4b03-a391-15ab92b9e0fb]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:11 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 Jun 16 08:48:11 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:11 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.info" returned: 0 in 0.590s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.897s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9aee888c-4aea-414e-9bcf-2d7b91ef15f4 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 19.209s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:11 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-9aee888c-4aea-414e-9bcf-2d7b91ef15f4 tempest-VolumesSnapshotListTestJSON-1185929747 None] Creating offline snapshot ddf7e912-319d-493a-8f90-a207c131af0b of volume 6e5b650a-6e03-4d00-b506-4df9ad40c179 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:48:11 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc54b15b-a537-4459-84a9-a540ba9842df]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9aee888c-4aea-414e-9bcf-2d7b91ef15f4 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:11 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-eb385e6f-37b0-4d34-98d3-0bb6bd56aba7 tempest-VolumesDeleteCascade-200718758 None] Create snapshot completed successfully Jun 16 08:48:11 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 Jun 16 08:48:11 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:11 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41" returned: 0 in 0.710s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:11 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41 Jun 16 08:48:11 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:12 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9aee888c-4aea-414e-9bcf-2d7b91ef15f4 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743" returned: 0 in 0.681s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-9aee888c-4aea-414e-9bcf-2d7b91ef15f4 tempest-VolumesSnapshotListTestJSON-1185929747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e5b650a-6e03-4d00-b506-4df9ad40c179(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:48:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9aee888c-4aea-414e-9bcf-2d7b91ef15f4 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:12 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-66b72e45-175a-4339-953d-41cb3ed18f41" returned: 0 in 0.595s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:12 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b 1G Jun 16 08:48:12 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] Lock "cinder-quobyte-66b72e45-175a-4339-953d-41cb3ed18f41" released by "delete_volume" :: held 1.357s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:12 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] Created reservations ['b9954a60-bea3-4f0a-98fc-229e216478d5', 'e02a1fa1-224a-4a8a-b7eb-e9673fdc001b', '4fc94837-f152-4ea2-ac6c-0d7f59ab8ea9', '8d804b18-0cbb-432e-8b5a-650e37597a93'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:48:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:48:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:48:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:12 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:48:12 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5da42629-970c-40cf-9126-ade36c289620 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:13 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9aee888c-4aea-414e-9bcf-2d7b91ef15f4 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b 1G" returned: 0 in 0.765s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9aee888c-4aea-414e-9bcf-2d7b91ef15f4 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:13 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.615s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:13 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:48:13 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] Deleted volume successfully. Jun 16 08:48:13 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b Jun 16 08:48:13 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-00ed7346-23a8-4b24-a5a5-1df7d07e1c22 tempest-VolumesCloneTest-1717242219 None] Lock "cinder-66b72e45-175a-4339-953d-41cb3ed18f41-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:14 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9aee888c-4aea-414e-9bcf-2d7b91ef15f4 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b" returned: 0 in 0.777s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:14 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-9aee888c-4aea-414e-9bcf-2d7b91ef15f4 tempest-VolumesSnapshotListTestJSON-1185929747 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b is being set with open permissions: ugo+rw Jun 16 08:48:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9aee888c-4aea-414e-9bcf-2d7b91ef15f4 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:14 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b Jun 16 08:48:14 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:14 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9aee888c-4aea-414e-9bcf-2d7b91ef15f4 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b" returned: 0 in 0.650s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9aee888c-4aea-414e-9bcf-2d7b91ef15f4 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.988s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5da42629-970c-40cf-9126-ade36c289620 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.851s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:14 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-5da42629-970c-40cf-9126-ade36c289620 tempest-VolumesDeleteCascade-200718758 None] Creating offline snapshot a44f6b27-b165-43f4-941e-897aecddf7ee of volume b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:48:14 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-9aee888c-4aea-414e-9bcf-2d7b91ef15f4 tempest-VolumesSnapshotListTestJSON-1185929747 None] Create snapshot completed successfully Jun 16 08:48:14 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2119480a-420a-4028-aacf-b3fd975c8c54]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5da42629-970c-40cf-9126-ade36c289620 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:14 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e Jun 16 08:48:14 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:15 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5da42629-970c-40cf-9126-ade36c289620 tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e" returned: 0 in 0.895s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:15 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-5da42629-970c-40cf-9126-ade36c289620 tempest-VolumesDeleteCascade-200718758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:48:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5da42629-970c-40cf-9126-ade36c289620 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:15 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee 1G Jun 16 08:48:15 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Acquiring lock "cinder-ddf7e912-319d-493a-8f90-a207c131af0b-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-ddf7e912-319d-493a-8f90-a207c131af0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Acquiring lock "cinder-quobyte-6e5b650a-6e03-4d00-b506-4df9ad40c179" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-quobyte-6e5b650a-6e03-4d00-b506-4df9ad40c179" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Acquiring lock "cinder-quobyte-ddf7e912-319d-493a-8f90-a207c131af0b" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-quobyte-ddf7e912-319d-493a-8f90-a207c131af0b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Deleting offline snapshot ddf7e912-319d-493a-8f90-a207c131af0b of volume 6e5b650a-6e03-4d00-b506-4df9ad40c179 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:48:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] snapshot_file for this snap is: volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:48:16 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0233726a-f29a-45fe-85d9-b9fef63f80c8]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:16 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5da42629-970c-40cf-9126-ade36c289620 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee 1G" returned: 0 in 1.011s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5da42629-970c-40cf-9126-ade36c289620 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:16 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee Jun 16 08:48:16 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:16 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b Jun 16 08:48:16 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Flow 'volume_create_manager' (e3ac4cb3-cec6-484a-8fc1-405143aed911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce180d2b-ef92-497f-9c6f-1d1cbd760bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce180d2b-ef92-497f-9c6f-1d1cbd760bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-925773295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b649785e8e3844d6a0ca9397da97aaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:48:17Z,use_quota=True,user_id='d979c0848bb1467fa3407c0ffb322311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5255125-3164-4760-bcb4-5d0ff4ce9f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5255125-3164-4760-bcb4-5d0ff4ce9f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afcb8ee2-5d57-4e78-bb0b-d46ffeee5e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afcb8ee2-5d57-4e78-bb0b-d46ffeee5e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1', 'volume_name': 'volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a7762d-7d81-4c7c-ac27-735882687e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a7762d-7d81-4c7c-ac27-735882687e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04434e21-fa8d-4011-b378-713c4c0368d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:17 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Volume ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1', 'volume_size': 1} Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:17 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b" returned: 0 in 0.947s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e5b650a-6e03-4d00-b506-4df9ad40c179(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:48:17 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5da42629-970c-40cf-9126-ade36c289620 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee" returned: 0 in 0.932s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:17 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-5da42629-970c-40cf-9126-ade36c289620 tempest-VolumesDeleteCascade-200718758 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee is being set with open permissions: ugo+rw Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5da42629-970c-40cf-9126-ade36c289620 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[841511f1-eee5-4c85-81ad-143440ff3fa0]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:17 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee Jun 16 08:48:17 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:17 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 Jun 16 08:48:17 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:18 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5da42629-970c-40cf-9126-ade36c289620 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee" returned: 0 in 0.596s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5da42629-970c-40cf-9126-ade36c289620 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.573s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.765s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:18 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-925773295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b649785e8e3844d6a0ca9397da97aaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:48:17Z,use_quota=True,user_id='d979c0848bb1467fa3407c0ffb322311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:48:18 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Creating volume ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:48:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:18 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:48:18 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:48:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:18 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:48:18 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:48:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:18 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1 1073741824 Jun 16 08:48:18 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:18 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-5da42629-970c-40cf-9126-ade36c289620 tempest-VolumesDeleteCascade-200718758 None] Create snapshot completed successfully Jun 16 08:48:18 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743" returned: 0 in 0.760s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:18 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e5b650a-6e03-4d00-b506-4df9ad40c179(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:48:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:18 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b Jun 16 08:48:18 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:19 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1 1073741824" returned: 0 in 0.845s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:19 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1 Jun 16 08:48:19 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "cinder-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:19 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b" returned: 0 in 0.834s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:19 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b Jun 16 08:48:19 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Performing cascade delete. {{(pid=92348) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "cinder-901e1e82-7e15-41a0-bdc6-e61258a8b47e-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-901e1e82-7e15-41a0-bdc6-e61258a8b47e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "cinder-quobyte-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "cinder-quobyte-901e1e82-7e15-41a0-bdc6-e61258a8b47e" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-901e1e82-7e15-41a0-bdc6-e61258a8b47e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Deleting offline snapshot 901e1e82-7e15-41a0-bdc6-e61258a8b47e of volume b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] snapshot_file for this snap is: volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc540608-bed1-4035-85cc-80179d8256ec]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:19 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e Jun 16 08:48:19 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:19 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1" returned: 0 in 0.786s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:48:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04434e21-fa8d-4011-b378-713c4c0368d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5f0d97-9a6f-448a-91df-5a91bd80eb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:20 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:20 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Volume volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1 (ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1): created successfully Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5f0d97-9a6f-448a-91df-5a91bd80eb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Flow 'volume_create_manager' (e3ac4cb3-cec6-484a-8fc1-405143aed911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.ddf7e912-319d-493a-8f90-a207c131af0b" returned: 0 in 0.800s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:20 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-21342f85-7ec3-46d7-9ec6-5d23885b48d3 tempest-AttachVolumeTestJSON-1013321509 None] Created volume successfully. Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-quobyte-ddf7e912-319d-493a-8f90-a207c131af0b" released by "_delete_snapshot" :: held 3.490s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-quobyte-6e5b650a-6e03-4d00-b506-4df9ad40c179" released by "delete_snapshot" :: held 3.526s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Created reservations ['feae6099-074c-4107-b6a0-4040806da0f9', 'eaeb8331-be7d-4dae-a07f-e98538cdb62f', '8832910a-3b26-4ddc-9ab8-b75a799eacab', '8aaea0d6-4fa2-40e7-a9b7-55748c94a8d7'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:48:20 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Delete snapshot completed successfully. Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a8f0e296-d2aa-4dfd-8402-59d7c4598f43 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-ddf7e912-319d-493a-8f90-a207c131af0b-delete_snapshot" released by "delete_snapshot" :: held 3.676s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:20 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e" returned: 0 in 0.890s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[210fc4e6-86fa-4494-aae5-b437ca33a9ae]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:20 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 Jun 16 08:48:20 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Acquiring lock "cinder-0fb2f3b2-2adb-4780-82b2-5f19d8249743-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-0fb2f3b2-2adb-4780-82b2-5f19d8249743-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Acquiring lock "cinder-quobyte-6e5b650a-6e03-4d00-b506-4df9ad40c179" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-quobyte-6e5b650a-6e03-4d00-b506-4df9ad40c179" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Acquiring lock "cinder-quobyte-0fb2f3b2-2adb-4780-82b2-5f19d8249743" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-quobyte-0fb2f3b2-2adb-4780-82b2-5f19d8249743" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Deleting offline snapshot 0fb2f3b2-2adb-4780-82b2-5f19d8249743 of volume 6e5b650a-6e03-4d00-b506-4df9ad40c179 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] snapshot_file for this snap is: volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[509f961e-e8ae-44d9-8411-b274a700b15f]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:21 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 Jun 16 08:48:21 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:21 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3" returned: 0 in 0.848s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:21 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9cc298-d020-41fa-97ad-c1165f31d0b3]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:21 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee Jun 16 08:48:21 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:21 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743" returned: 0 in 0.902s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e5b650a-6e03-4d00-b506-4df9ad40c179(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:48:21 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23241d9-e3a3-4ae5-abb5-77967556e8a8]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:22 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 Jun 16 08:48:22 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:22 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee" returned: 0 in 0.863s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:48:22 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2da3f33-c475-4d35-a18f-013ff3b475bc]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:22 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e Jun 16 08:48:22 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:22 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900" returned: 0 in 0.897s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e5b650a-6e03-4d00-b506-4df9ad40c179(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:48:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:22 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 Jun 16 08:48:22 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:23 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e" returned: 0 in 0.890s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:48:23 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaef4bdb-529f-437c-bc7b-e18158371069]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:23 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 Jun 16 08:48:23 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:23 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743" returned: 0 in 0.929s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:23 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743 Jun 16 08:48:23 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-89e605e3-cee2-4466-8227-73d89b6123b8 req-63df7f9f-d8fe-4ba8-b6a9-a9f8b6c73747 tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-89e605e3-cee2-4466-8227-73d89b6123b8 req-63df7f9f-d8fe-4ba8-b6a9-a9f8b6c73747 tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:23 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93b449a-54aa-45f6-bf61-c633244dbcb4]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-89e605e3-cee2-4466-8227-73d89b6123b8 req-63df7f9f-d8fe-4ba8-b6a9-a9f8b6c73747 tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:24 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3" returned: 0 in 0.919s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:24 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1 Jun 16 08:48:24 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:24 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e Jun 16 08:48:24 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:24 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.0fb2f3b2-2adb-4780-82b2-5f19d8249743" returned: 0 in 0.839s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:24 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-quobyte-0fb2f3b2-2adb-4780-82b2-5f19d8249743" released by "_delete_snapshot" :: held 3.739s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:24 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-quobyte-6e5b650a-6e03-4d00-b506-4df9ad40c179" released by "delete_snapshot" :: held 3.764s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:24 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Created reservations ['4743661e-ed95-4b2f-8d8d-d28912a308a5', '5ad9cc38-2974-45ef-9571-e0fced86d2b9', 'c7083f96-62a1-4eca-baa7-200161d46e21', '2b2286af-4ffa-4eab-a0d8-4443fc071b81'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:48:24 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Delete snapshot completed successfully. Jun 16 08:48:24 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0ba4c9d7-98b3-431e-8602-7c817be96986 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-0fb2f3b2-2adb-4780-82b2-5f19d8249743-delete_snapshot" released by "delete_snapshot" :: held 3.946s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:24 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e" returned: 0 in 0.864s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:24 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-89e605e3-cee2-4466-8227-73d89b6123b8 req-63df7f9f-d8fe-4ba8-b6a9-a9f8b6c73747 tempest-AttachVolumeTestJSON-1013321509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1" returned: 0 in 0.982s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-89e605e3-cee2-4466-8227-73d89b6123b8 req-63df7f9f-d8fe-4ba8-b6a9-a9f8b6c73747 tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.016s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:24 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e Jun 16 08:48:24 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-89e605e3-cee2-4466-8227-73d89b6123b8 req-63df7f9f-d8fe-4ba8-b6a9-a9f8b6c73747 tempest-AttachVolumeTestJSON-1013321509 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f454e83c-445a-48fd-8972-96328cb1b3fb', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:48:25 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-89e605e3-cee2-4466-8227-73d89b6123b8 req-63df7f9f-d8fe-4ba8-b6a9-a9f8b6c73747 tempest-AttachVolumeTestJSON-1013321509 None] attachment_update completed successfully. Jun 16 08:48:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] Acquiring lock "cinder-b5cdb866-7a7b-4faf-a633-a734f104c900-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-b5cdb866-7a7b-4faf-a633-a734f104c900-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] Acquiring lock "cinder-quobyte-6e5b650a-6e03-4d00-b506-4df9ad40c179" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-quobyte-6e5b650a-6e03-4d00-b506-4df9ad40c179" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] Acquiring lock "cinder-quobyte-b5cdb866-7a7b-4faf-a633-a734f104c900" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-quobyte-b5cdb866-7a7b-4faf-a633-a734f104c900" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] Deleting offline snapshot b5cdb866-7a7b-4faf-a633-a734f104c900 of volume 6e5b650a-6e03-4d00-b506-4df9ad40c179 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:48:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] snapshot_file for this snap is: volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:48:25 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db32cd8-e7cc-45fc-8baf-0bfc9b7d7c2a]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:25 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 Jun 16 08:48:25 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:25 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.901e1e82-7e15-41a0-bdc6-e61258a8b47e" returned: 0 in 0.839s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee -F qcow2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:25 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee -F qcow2 Jun 16 08:48:25 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:26 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900" returned: 0 in 0.932s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e5b650a-6e03-4d00-b506-4df9ad40c179(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f11294-a67d-41f8-869e-17269e17d800]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:26 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179 Jun 16 08:48:26 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:26 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee -F qcow2" returned: 0 in 0.729s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-901e1e82-7e15-41a0-bdc6-e61258a8b47e" released by "_delete_snapshot" :: held 7.072s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3" released by "delete_snapshot" :: held 7.104s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Created reservations ['1e314bec-a20a-4469-8220-f6e848926b6f', 'dda51131-98ae-4cea-b898-cff8b360f825', '4c088474-c647-4c2a-95ef-befa694cafe8', '851c795b-dbec-4e8f-b6dd-3a5f21dc518a'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:48:26 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Delete snapshot completed successfully. Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-901e1e82-7e15-41a0-bdc6-e61258a8b47e-delete_snapshot" released by "delete_snapshot" :: held 7.350s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "cinder-a44f6b27-b165-43f4-941e-897aecddf7ee-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-a44f6b27-b165-43f4-941e-897aecddf7ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "cinder-quobyte-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "cinder-quobyte-a44f6b27-b165-43f4-941e-897aecddf7ee" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-a44f6b27-b165-43f4-941e-897aecddf7ee" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Deleting offline snapshot a44f6b27-b165-43f4-941e-897aecddf7ee of volume b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] snapshot_file for this snap is: volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea13eae5-8fc1-415b-984e-f8f45ab12633]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:48:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Flow 'volume_create_manager' (e7b8994d-396b-411b-909b-d02c7848b669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:48:26 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee Jun 16 08:48:26 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fcb4ef-e890-4589-8126-fb5e696d599e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fcb4ef-e890-4589-8126-fb5e696d599e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1444249366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c463d4ca-9f05-4a03-8ae3-7efe260c31c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67112c8977d0413f81dcac4eac67d95d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:48:27Z,use_quota=True,user_id='e892f71d55e9458185b214ef03da8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1b57bd-c4b4-42d6-aea5-ff300d2e2655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1b57bd-c4b4-42d6-aea5-ff300d2e2655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd14572b-dda2-479a-88f7-559cc7763a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd14572b-dda2-479a-88f7-559cc7763a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c463d4ca-9f05-4a03-8ae3-7efe260c31c2', 'volume_name': 'volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe9bb07-1cb3-4406-ac7d-fe01664d65be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe9bb07-1cb3-4406-ac7d-fe01664d65be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eeed040-9ee1-40c0-b7b8-1e33d383e03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:27 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Volume c463d4ca-9f05-4a03-8ae3-7efe260c31c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2', 'volume_size': 1} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1444249366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c463d4ca-9f05-4a03-8ae3-7efe260c31c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67112c8977d0413f81dcac4eac67d95d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:48:27Z,use_quota=True,user_id='e892f71d55e9458185b214ef03da8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Creating volume c463d4ca-9f05-4a03-8ae3-7efe260c31c2 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:48:27 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:27 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2 1073741824 Jun 16 08:48:27 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:27 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179" returned: 0 in 0.858s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:27 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 Jun 16 08:48:27 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:27 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee" returned: 0 in 0.727s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e249ae3a-ab82-4f7f-b9e6-457cab3f9ac6]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:27 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 Jun 16 08:48:27 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:27 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900" returned: 0 in 0.724s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:27 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900 Jun 16 08:48:27 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2 1073741824" returned: 0 in 0.814s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:27 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:27 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2 Jun 16 08:48:27 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:28 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3" returned: 0 in 0.746s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:28 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee Jun 16 08:48:28 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:28 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179.b5cdb866-7a7b-4faf-a633-a734f104c900" returned: 0 in 0.662s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:28 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:28 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-quobyte-b5cdb866-7a7b-4faf-a633-a734f104c900" released by "_delete_snapshot" :: held 3.303s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2" returned: 0 in 0.632s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:48:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:28 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-quobyte-6e5b650a-6e03-4d00-b506-4df9ad40c179" released by "delete_snapshot" :: held 3.336s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eeed040-9ee1-40c0-b7b8-1e33d383e03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120442e1-943e-4708-a51d-353d3f61e08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:28 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Volume volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2 (c463d4ca-9f05-4a03-8ae3-7efe260c31c2): created successfully Jun 16 08:48:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120442e1-943e-4708-a51d-353d3f61e08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Flow 'volume_create_manager' (e7b8994d-396b-411b-909b-d02c7848b669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:48:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-968e979a-ca1a-4ccb-bb1f-21cf91e509d0 tempest-VolumesSnapshotTestJSON-2052748308 None] Created volume successfully. Jun 16 08:48:28 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] Created reservations ['ca603e54-0298-4e5a-8629-70ced1e91929', '496fd9e2-0a19-4b30-b5f9-2b6ac83737ca', '69648f44-a265-44c1-bf79-37458b3751ac', '8a30ee56-d7e0-42cd-88ee-241d7ea61a49'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:48:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] Delete snapshot completed successfully. Jun 16 08:48:28 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-36235b7a-4f99-4795-8fc8-8c4991a4b8e8 tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-b5cdb866-7a7b-4faf-a633-a734f104c900-delete_snapshot" released by "delete_snapshot" :: held 3.533s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:29 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee" returned: 0 in 0.671s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:29 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee Jun 16 08:48:29 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] Creating offline snapshot a3f17fdf-d455-44f4-af50-cf18ff315117 of volume c463d4ca-9f05-4a03-8ae3-7efe260c31c2 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f9d163-823d-4b4b-8557-94d90acf6d55]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] Acquiring lock "cinder-6e5b650a-6e03-4d00-b506-4df9ad40c179-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:29 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2 Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-6e5b650a-6e03-4d00-b506-4df9ad40c179-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:29 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] Acquiring lock "cinder-quobyte-6e5b650a-6e03-4d00-b506-4df9ad40c179" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-quobyte-6e5b650a-6e03-4d00-b506-4df9ad40c179" acquired by "delete_volume" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6520b4a-3423-4430-bb62-ac57becbb94b]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:29 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3.a44f6b27-b165-43f4-941e-897aecddf7ee" returned: 0 in 0.605s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-a44f6b27-b165-43f4-941e-897aecddf7ee" released by "_delete_snapshot" :: held 2.880s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3" released by "delete_snapshot" :: held 2.912s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:29 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179 Jun 16 08:48:29 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Created reservations ['571b3d23-b582-4c4d-a70a-d20c9878c88e', '7528a2e5-365a-4050-839b-b8b1d9039740', '834a4092-3d83-444d-a1b9-7aa127d329ee', 'c6eae98a-384e-4aed-9783-2eef5d9598de'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:48:29 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Delete snapshot completed successfully. Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-a44f6b27-b165-43f4-941e-897aecddf7ee-delete_snapshot" released by "delete_snapshot" :: held 3.105s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Snapshots deleted, issuing volume delete {{(pid=92348) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "cinder-quobyte-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3" acquired by "delete_volume" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e67080-4de7-40ed-a9b4-0f940c11a2ac]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:30 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 Jun 16 08:48:30 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:48:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:48:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:48:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:30 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:48:30 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2" returned: 0 in 0.999s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:30 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:30 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117 1G Jun 16 08:48:30 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:30 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179" returned: 0 in 1.034s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:30 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179 Jun 16 08:48:30 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:30 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3" returned: 0 in 1.047s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:31 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3 Jun 16 08:48:31 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:31 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.869s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:48:31 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117 1G" returned: 0 in 1.003s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:31 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e5b650a-6e03-4d00-b506-4df9ad40c179" returned: 0 in 0.784s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:31 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117 Jun 16 08:48:31 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-quobyte-6e5b650a-6e03-4d00-b506-4df9ad40c179" released by "delete_volume" :: held 1.882s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] Created reservations ['11f2b16d-dd80-478e-b2d0-627fae65c059', '3505dce5-a8c9-4eac-97bb-84695987e672', '0b7d088b-3a4c-467c-a22f-0871f0201e2a', '58050b58-07f9-4fc1-97b5-a8c7265b7072'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:31 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:48:31 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:31 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3" returned: 0 in 0.718s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3" released by "delete_volume" :: held 1.845s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:31 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Created reservations ['2eaa0c4f-1ceb-4cd0-963d-09d6edeaf476', '23b9cfc5-3b1b-4229-ada1-e3151045493a', '506f373f-169e-4f76-aebf-483724455ff6', 'dbbcaca2-4d76-40fc-befe-1bdb96679bc0'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:48:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:48:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:48:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:32 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:48:32 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:32 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117" returned: 0 in 1.051s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:32 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117 is being set with open permissions: ugo+rw Jun 16 08:48:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:32 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117 Jun 16 08:48:32 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:32 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.145s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:32 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:48:32 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] Deleted volume successfully. Jun 16 08:48:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c0f8e954-c724-4dbb-a45f-c1b60c69bddf tempest-VolumesSnapshotListTestJSON-1185929747 None] Lock "cinder-6e5b650a-6e03-4d00-b506-4df9ad40c179-delete_volume" released by "delete_volume" :: held 3.264s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:33 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:48:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Flow 'volume_create_manager' (be54d975-61e5-4788-9a3e-2d905d5dfe42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:48:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7b5eb3-a3f2-42a3-9eb3-eb715402e90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7b5eb3-a3f2-42a3-9eb3-eb715402e90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-754252608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2022f6a-a98f-42cd-af11-f23d1a5751ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb518087403437a9d131d7561266de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:48:33Z,use_quota=True,user_id='0e073dd50a5741ac93db5abb7d8aa8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165c38d2-0bb7-461d-9303-27e3ce7113e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165c38d2-0bb7-461d-9303-27e3ce7113e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0427d06c-da26-4b80-84ec-33974396c0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0427d06c-da26-4b80-84ec-33974396c0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2022f6a-a98f-42cd-af11-f23d1a5751ea', 'volume_name': 'volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1259f317-1440-4a8d-89c1-87a7be279090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1259f317-1440-4a8d-89c1-87a7be279090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119a293f-1108-48c4-ab54-a7d8e3cf5f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:33 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Volume e2022f6a-a98f-42cd-af11-f23d1a5751ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea', 'volume_size': 1} Jun 16 08:48:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:33 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.207s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:33 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:48:33 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Deleted volume successfully. Jun 16 08:48:33 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4dd9b5ff-0519-4ebe-9f3b-fddd29d9ef96 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-b815b3ac-8ab2-41f9-aa81-d21ce2eeb0e3-delete_volume" released by "delete_volume" :: held 14.051s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:33 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117" returned: 0 in 0.941s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:33 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.info Jun 16 08:48:33 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:34 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.info" returned: 0 in 0.686s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:34 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.info is being set with open permissions: ugo+rw Jun 16 08:48:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:34 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.info Jun 16 08:48:34 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:34 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.info" returned: 0 in 0.607s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.372s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.499s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-754252608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2022f6a-a98f-42cd-af11-f23d1a5751ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb518087403437a9d131d7561266de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:48:33Z,use_quota=True,user_id='0e073dd50a5741ac93db5abb7d8aa8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:48:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Creating volume e2022f6a-a98f-42cd-af11-f23d1a5751ea {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:48:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:48:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:48:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:48:34 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:48:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:34 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea 1073741824 Jun 16 08:48:34 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:34 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-2cf2e7f2-bb3c-48f7-b72b-b4642e1ead7b tempest-VolumesSnapshotTestJSON-2052748308 None] Create snapshot completed successfully Jun 16 08:48:35 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea 1073741824" returned: 0 in 0.947s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:35 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea Jun 16 08:48:35 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:35 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-a3f17fdf-d455-44f4-af50-cf18ff315117-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:35 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-a3f17fdf-d455-44f4-af50-cf18ff315117-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:35 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-quobyte-c463d4ca-9f05-4a03-8ae3-7efe260c31c2" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:35 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-c463d4ca-9f05-4a03-8ae3-7efe260c31c2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:35 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-quobyte-a3f17fdf-d455-44f4-af50-cf18ff315117" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:36 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-a3f17fdf-d455-44f4-af50-cf18ff315117" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] Deleting offline snapshot a3f17fdf-d455-44f4-af50-cf18ff315117 of volume c463d4ca-9f05-4a03-8ae3-7efe260c31c2 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:48:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] snapshot_file for this snap is: volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:48:36 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d72961-a8f0-4ef9-888b-c69fb899e62f]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:36 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117 Jun 16 08:48:36 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:36 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea" returned: 0 in 0.855s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:48:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119a293f-1108-48c4-ab54-a7d8e3cf5f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670b2e5c-51d3-4401-bb7f-9fbf56d88b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:36 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Volume volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea (e2022f6a-a98f-42cd-af11-f23d1a5751ea): created successfully Jun 16 08:48:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670b2e5c-51d3-4401-bb7f-9fbf56d88b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Flow 'volume_create_manager' (be54d975-61e5-4788-9a3e-2d905d5dfe42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:48:36 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-21e3f3a8-342a-4832-8356-c56216d3ae76 tempest-VolumesDeleteCascade-200718758 None] Created volume successfully. Jun 16 08:48:36 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117" returned: 0 in 0.898s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:48:36 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[69721263-0fc6-4f67-8592-9db751c46b91]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:37 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2 Jun 16 08:48:37 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] Creating offline snapshot ac3e15ea-67c9-4bf6-aba6-dafec78790be of volume e2022f6a-a98f-42cd-af11-f23d1a5751ea {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:48:37 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9fff66-86b8-4160-b098-50ced268f2b0]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:37 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea Jun 16 08:48:37 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:37 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2" returned: 0 in 0.779s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:37 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117 Jun 16 08:48:37 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:38 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea" returned: 0 in 0.848s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:38 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be 1G Jun 16 08:48:38 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:38 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117" returned: 0 in 0.889s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:38 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117 Jun 16 08:48:38 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:39 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2.a3f17fdf-d455-44f4-af50-cf18ff315117" returned: 0 in 0.725s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:39 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be 1G" returned: 0 in 0.938s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:39 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be Jun 16 08:48:39 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-a3f17fdf-d455-44f4-af50-cf18ff315117" released by "_delete_snapshot" :: held 3.440s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-c463d4ca-9f05-4a03-8ae3-7efe260c31c2" released by "delete_snapshot" :: held 3.481s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:39 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] Created reservations ['b554cf93-acd2-46e4-9462-2ac6b9e052e9', '354237d6-1b16-420a-9e5d-efba3485b4d4', '75179aad-4674-4d81-a6d2-663dd30813e3', '85d18c75-424b-43b3-8d82-bdb11fd875c1'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:48:39 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] Delete snapshot completed successfully. Jun 16 08:48:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-198ddc88-508a-40de-9aeb-cd0160d75bea tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-a3f17fdf-d455-44f4-af50-cf18ff315117-delete_snapshot" released by "delete_snapshot" :: held 3.663s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:40 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be" returned: 0 in 0.881s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:40 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be is being set with open permissions: ugo+rw Jun 16 08:48:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:40 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be Jun 16 08:48:40 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:40 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:48:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Flow 'volume_create_manager' (7343dbcc-b25c-4107-bd3c-2e014c596486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:48:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7981e6de-16ed-4a44-8c8f-bdfd2d4f86e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7981e6de-16ed-4a44-8c8f-bdfd2d4f86e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1653620085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfdcd399-0cc7-451b-beee-94fe0557407f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67112c8977d0413f81dcac4eac67d95d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:48:41Z,use_quota=True,user_id='e892f71d55e9458185b214ef03da8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ee797e-c5da-408e-b587-8452ce3e544a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ee797e-c5da-408e-b587-8452ce3e544a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e0e71f-4f06-4b9d-b6d3-d1e0fdf79cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e0e71f-4f06-4b9d-b6d3-d1e0fdf79cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfdcd399-0cc7-451b-beee-94fe0557407f', 'volume_name': 'volume-cfdcd399-0cc7-451b-beee-94fe0557407f', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03dcbad3-6197-45ee-a628-fcd1b23b9832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03dcbad3-6197-45ee-a628-fcd1b23b9832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c8be062-2715-4104-863c-320bf5353f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:40 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Volume cfdcd399-0cc7-451b-beee-94fe0557407f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfdcd399-0cc7-451b-beee-94fe0557407f', 'volume_size': 1} Jun 16 08:48:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:41 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be" returned: 0 in 0.734s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:41 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.info Jun 16 08:48:41 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:41 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.info" returned: 0 in 0.629s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:41 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.info is being set with open permissions: ugo+rw Jun 16 08:48:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:41 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.info Jun 16 08:48:41 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:42 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.info" returned: 0 in 0.680s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.809s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.510s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1653620085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfdcd399-0cc7-451b-beee-94fe0557407f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67112c8977d0413f81dcac4eac67d95d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:48:41Z,use_quota=True,user_id='e892f71d55e9458185b214ef03da8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:48:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Creating volume cfdcd399-0cc7-451b-beee-94fe0557407f {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:48:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:48:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:48:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:48:42 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:48:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:42 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f 1073741824 Jun 16 08:48:42 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:42 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4390fbd7-4f34-4aee-975f-a1b2c10eec02 tempest-VolumesDeleteCascade-200718758 None] Create snapshot completed successfully Jun 16 08:48:43 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:48:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Flow 'volume_create_manager' (6b7abf6f-3cf6-4aa1-8117-0bf397e61f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:48:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59d2f0c-10bc-49af-ab3b-25cb69571bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59d2f0c-10bc-49af-ab3b-25cb69571bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1484973879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1a1fbe-24a4-4460-b939-73923513be19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb518087403437a9d131d7561266de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ac3e15ea-67c9-4bf6-aba6-dafec78790be,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:48:44Z,use_quota=True,user_id='0e073dd50a5741ac93db5abb7d8aa8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37547180-a27e-46a3-9205-df548673a5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:43 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37547180-a27e-46a3-9205-df548673a5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2230fbd-0859-42a3-98e1-8cf36c8c21b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2230fbd-0859-42a3-98e1-8cf36c8c21b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bb1a1fbe-24a4-4460-b939-73923513be19', 'volume_name': 'volume-bb1a1fbe-24a4-4460-b939-73923513be19', 'volume_size': 1, 'snapshot_id': 'ac3e15ea-67c9-4bf6-aba6-dafec78790be'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b4efbf-7430-4894-b265-7d15e6f0dbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b4efbf-7430-4894-b265-7d15e6f0dbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b33490-9d88-4261-acf0-bb51475cbf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:43 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Volume bb1a1fbe-24a4-4460-b939-73923513be19: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bb1a1fbe-24a4-4460-b939-73923513be19', 'volume_size': 1, 'snapshot_id': 'ac3e15ea-67c9-4bf6-aba6-dafec78790be'} Jun 16 08:48:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f 1073741824" returned: 0 in 1.500s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:44 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f Jun 16 08:48:44 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:44 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f" returned: 0 in 0.746s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] <== create_volume: return (2337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.340s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.820s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "cinder-quobyte-ac3e15ea-67c9-4bf6-aba6-dafec78790be-bb1a1fbe-24a4-4460-b939-73923513be19" by "_create_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c8be062-2715-4104-863c-320bf5353f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfdcd399-0cc7-451b-beee-94fe0557407f', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c636ed-7eb6-4e83-9a50-20c3a4ac38ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-ac3e15ea-67c9-4bf6-aba6-dafec78790be-bb1a1fbe-24a4-4460-b939-73923513be19" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Creating volume bb1a1fbe-24a4-4460-b939-73923513be19 from snapshot ac3e15ea-67c9-4bf6-aba6-dafec78790be {{(pid=92348) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "cinder-quobyte-bb1a1fbe-24a4-4460-b939-73923513be19" by "_copy_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:44 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Volume volume-cfdcd399-0cc7-451b-beee-94fe0557407f (cfdcd399-0cc7-451b-beee-94fe0557407f): created successfully Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c636ed-7eb6-4e83-9a50-20c3a4ac38ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Flow 'volume_create_manager' (7343dbcc-b25c-4107-bd3c-2e014c596486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-bb1a1fbe-24a4-4460-b939-73923513be19" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] snapshot: ac3e15ea-67c9-4bf6-aba6-dafec78790be, volume: bb1a1fbe-24a4-4460-b939-73923513be19, {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 16 08:48:44 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-965ec985-9383-4161-8aea-b75117e279c7 tempest-VolumesSnapshotTestJSON-2052748308 None] Created volume successfully. Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e231c6f-045f-4ca2-9739-5596119a70a7]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:45 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be Jun 16 08:48:45 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:48:45 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be" returned: 0 in 1.051s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:45 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:48:45 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 16 08:48:45 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Creating direct copy from snapshot {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 16 08:48:45 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66fd504-eac2-48a5-a927-2cdf2ea2fd58]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:46 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea Jun 16 08:48:46 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:47 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea" returned: 0 in 1.039s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:47 devstack cinder-volume[92348]: DEBUG cinder.utils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Path /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bb1a1fbe-24a4-4460-b939-73923513be19 not found in is_blk_device check {{(pid=92348) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 16 08:48:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bb1a1fbe-24a4-4460-b939-73923513be19 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:47 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bb1a1fbe-24a4-4460-b939-73923513be19 Jun 16 08:48:47 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:53 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bb1a1fbe-24a4-4460-b939-73923513be19" returned: 0 in 6.060s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:53 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1102f022-5f10-4b9e-a6f7-cb69b4469f8e]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:53 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea Jun 16 08:48:53 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:54 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea" returned: 0 in 0.923s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:54 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bb1a1fbe-24a4-4460-b939-73923513be19 {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:48:54 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Converted 1024.00 MB image at 168.89 MB/s Jun 16 08:48:54 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bb1a1fbe-24a4-4460-b939-73923513be19 is being set with open permissions: ugo+rw Jun 16 08:48:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bb1a1fbe-24a4-4460-b939-73923513be19 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:54 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bb1a1fbe-24a4-4460-b939-73923513be19 Jun 16 08:48:54 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:54 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bb1a1fbe-24a4-4460-b939-73923513be19" returned: 0 in 0.615s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-bb1a1fbe-24a4-4460-b939-73923513be19" released by "_copy_volume_from_snapshot" :: held 9.847s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-ac3e15ea-67c9-4bf6-aba6-dafec78790be-bb1a1fbe-24a4-4460-b939-73923513be19" released by "_create_volume_from_snapshot" :: held 9.906s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.959s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:48:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.151s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:48:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] Creating offline snapshot 68fc8e35-6716-4f82-aa8f-e7d933ff599a of volume cfdcd399-0cc7-451b-beee-94fe0557407f {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:48:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b33490-9d88-4261-acf0-bb51475cbf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb1a1fbe-24a4-4460-b939-73923513be19', 'volume_size': 1, 'snapshot_id': 'ac3e15ea-67c9-4bf6-aba6-dafec78790be'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5253e1-1a64-42df-a04d-38e51ce1e53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:48:54 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8231d8d3-36a9-44d6-b08d-66bf6a7d5cf5]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:54 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Volume volume-bb1a1fbe-24a4-4460-b939-73923513be19 (bb1a1fbe-24a4-4460-b939-73923513be19): created successfully Jun 16 08:48:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5253e1-1a64-42df-a04d-38e51ce1e53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:48:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Flow 'volume_create_manager' (6b7abf6f-3cf6-4aa1-8117-0bf397e61f5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:48:54 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-0e37dc55-8541-47f5-a3e9-f7fe8becf213 tempest-VolumesDeleteCascade-200718758 None] Created volume successfully. Jun 16 08:48:54 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f Jun 16 08:48:54 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "cinder-e2022f6a-a98f-42cd-af11-f23d1a5751ea-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-e2022f6a-a98f-42cd-af11-f23d1a5751ea-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Performing cascade delete. {{(pid=92348) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 16 08:48:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "cinder-ac3e15ea-67c9-4bf6-aba6-dafec78790be-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-ac3e15ea-67c9-4bf6-aba6-dafec78790be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "cinder-quobyte-e2022f6a-a98f-42cd-af11-f23d1a5751ea" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-e2022f6a-a98f-42cd-af11-f23d1a5751ea" acquired by "delete_snapshot" :: waited 0.030s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "cinder-quobyte-ac3e15ea-67c9-4bf6-aba6-dafec78790be" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:48:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-ac3e15ea-67c9-4bf6-aba6-dafec78790be" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:48:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Deleting offline snapshot ac3e15ea-67c9-4bf6-aba6-dafec78790be of volume e2022f6a-a98f-42cd-af11-f23d1a5751ea {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:48:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] snapshot_file for this snap is: volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:48:55 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b026535f-bf6a-4ced-be02-77d3ce7f5798]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:55 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be Jun 16 08:48:55 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:55 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f" returned: 0 in 0.968s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:55 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a 1G Jun 16 08:48:55 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:56 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be" returned: 0 in 0.948s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:48:56 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3622ece9-99a6-4317-a26d-57d4cccac9a2]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:48:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:56 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea Jun 16 08:48:56 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:57 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a 1G" returned: 0 in 1.274s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdcd399-0cc7-451b-beee-94fe0557407f -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:57 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdcd399-0cc7-451b-beee-94fe0557407f -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a Jun 16 08:48:57 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:57 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea" returned: 0 in 0.953s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:57 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be Jun 16 08:48:57 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:58 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfdcd399-0cc7-451b-beee-94fe0557407f -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a" returned: 0 in 1.338s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:58 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a is being set with open permissions: ugo+rw Jun 16 08:48:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:58 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a Jun 16 08:48:58 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:58 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be" returned: 0 in 1.251s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:58 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be Jun 16 08:48:58 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:59 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a" returned: 0 in 0.938s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:48:59 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.info Jun 16 08:48:59 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:48:59 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Jun 16 08:48:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea.ac3e15ea-67c9-4bf6-aba6-dafec78790be" returned: 0 in 1.176s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:48:59 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-ac3e15ea-67c9-4bf6-aba6-dafec78790be" released by "_delete_snapshot" :: held 4.462s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:48:59 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-e2022f6a-a98f-42cd-af11-f23d1a5751ea" released by "delete_snapshot" :: held 4.499s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:00 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Created reservations ['e11126b7-fe3d-45ce-82a1-f58f0588dda4', 'c5ae2fb9-c957-4398-91ad-cd4b91ec80da', 'e86b3ff9-96e3-42a2-8188-2e898a8b3df3', '6f5f69e8-9428-43fa-a3d5-300364b32ca7'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:49:00 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Delete snapshot completed successfully. Jun 16 08:49:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-ac3e15ea-67c9-4bf6-aba6-dafec78790be-delete_snapshot" released by "delete_snapshot" :: held 4.708s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Snapshots deleted, issuing volume delete {{(pid=92348) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 16 08:49:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "cinder-quobyte-e2022f6a-a98f-42cd-af11-f23d1a5751ea" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-e2022f6a-a98f-42cd-af11-f23d1a5751ea" acquired by "delete_volume" :: waited 0.027s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:00 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b31387-cf18-41b6-85f0-0d47a07a9542]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:00 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea Jun 16 08:49:00 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:00 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.info" returned: 0 in 1.121s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:00 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.info is being set with open permissions: ugo+rw Jun 16 08:49:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:00 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.info Jun 16 08:49:00 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:01 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea" returned: 0 in 0.880s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:01 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea Jun 16 08:49:01 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:01 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.info" returned: 0 in 0.773s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.564s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:01 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-155069af-55d7-4352-b3d6-4a28b74688f5 tempest-VolumesSnapshotTestJSON-2052748308 None] Create snapshot completed successfully Jun 16 08:49:01 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2022f6a-a98f-42cd-af11-f23d1a5751ea" returned: 0 in 0.716s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-e2022f6a-a98f-42cd-af11-f23d1a5751ea" released by "delete_volume" :: held 1.716s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:01 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Created reservations ['9f71143b-16a6-4505-a4ee-5ae9f00d33f5', 'd6e160e8-80a7-46c7-b032-281d07541b2a', '877214a7-309b-4539-b34e-ea3abbbab2ae', 'e0d9df34-c7cb-4e3b-af52-2fe0f8e3cb5a'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:02 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:49:02 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Flow 'volume_create_manager' (8f18af79-d3dc-4b9a-b51b-e2311b3e934e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b4d4d5-c66f-467d-b978-8d8c8b788a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b4d4d5-c66f-467d-b978-8d8c8b788a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1139262924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0520b919-37d7-4cd1-8089-bcb6e20870f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67112c8977d0413f81dcac4eac67d95d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:49:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=68fc8e35-6716-4f82-aa8f-e7d933ff599a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:49:02Z,use_quota=True,user_id='e892f71d55e9458185b214ef03da8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d5acb4-0f3a-4270-8826-ef9152a8aa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d5acb4-0f3a-4270-8826-ef9152a8aa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5b3ab4-0a6a-445d-9cb0-da1310269807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5b3ab4-0a6a-445d-9cb0-da1310269807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0520b919-37d7-4cd1-8089-bcb6e20870f2', 'volume_name': 'volume-0520b919-37d7-4cd1-8089-bcb6e20870f2', 'volume_size': 2, 'snapshot_id': '68fc8e35-6716-4f82-aa8f-e7d933ff599a'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1f2d9d-10d1-4dc3-90f0-ff69c297ac01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1f2d9d-10d1-4dc3-90f0-ff69c297ac01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b888f6-b0bc-4d75-a139-54044b4a8082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:02 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Volume 0520b919-37d7-4cd1-8089-bcb6e20870f2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0520b919-37d7-4cd1-8089-bcb6e20870f2', 'volume_size': 2, 'snapshot_id': '68fc8e35-6716-4f82-aa8f-e7d933ff599a'} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "cinder-bb1a1fbe-24a4-4460-b939-73923513be19-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-quobyte-68fc8e35-6716-4f82-aa8f-e7d933ff599a-0520b919-37d7-4cd1-8089-bcb6e20870f2" by "_create_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-bb1a1fbe-24a4-4460-b939-73923513be19-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-68fc8e35-6716-4f82-aa8f-e7d933ff599a-0520b919-37d7-4cd1-8089-bcb6e20870f2" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Creating volume 0520b919-37d7-4cd1-8089-bcb6e20870f2 from snapshot 68fc8e35-6716-4f82-aa8f-e7d933ff599a {{(pid=92348) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-quobyte-0520b919-37d7-4cd1-8089-bcb6e20870f2" by "_copy_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-0520b919-37d7-4cd1-8089-bcb6e20870f2" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] snapshot: 68fc8e35-6716-4f82-aa8f-e7d933ff599a, volume: 0520b919-37d7-4cd1-8089-bcb6e20870f2, {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "cinder-quobyte-bb1a1fbe-24a4-4460-b939-73923513be19" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-bb1a1fbe-24a4-4460-b939-73923513be19" acquired by "delete_volume" :: waited 0.060s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[39533a37-75da-45dd-96ae-2b64ac119bcf]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40c64bc-40d4-444a-83ec-f26cf6b34763]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bb1a1fbe-24a4-4460-b939-73923513be19 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:02 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a Jun 16 08:49:02 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:02 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bb1a1fbe-24a4-4460-b939-73923513be19 Jun 16 08:49:02 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:02 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.852s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:02 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:49:02 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Deleted volume successfully. Jun 16 08:49:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cfdc9c66-48ca-4447-867a-7f1833f9806d tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-e2022f6a-a98f-42cd-af11-f23d1a5751ea-delete_volume" released by "delete_volume" :: held 7.701s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:03 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bb1a1fbe-24a4-4460-b939-73923513be19" returned: 0 in 0.811s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bb1a1fbe-24a4-4460-b939-73923513be19 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:03 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a" returned: 0 in 0.840s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:03 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfdcd399-0cc7-451b-beee-94fe0557407f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:49:03 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 16 08:49:03 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Creating direct copy from snapshot {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 16 08:49:03 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bb1a1fbe-24a4-4460-b939-73923513be19 Jun 16 08:49:03 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:03 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4944bc52-865c-44f7-aeb7-a867303ac0ad]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:03 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f Jun 16 08:49:03 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:04 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bb1a1fbe-24a4-4460-b939-73923513be19" returned: 0 in 0.821s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:04 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-quobyte-bb1a1fbe-24a4-4460-b939-73923513be19" released by "delete_volume" :: held 1.683s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:04 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:04 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] Created reservations ['0ea56765-c8cf-40db-b8a5-730c6af6810b', 'e48f6336-5379-47c2-be96-351ad6d39773', 'bd0db100-80c7-4b29-82a5-ff96f38f96ed', '8c22037f-ec9a-4380-a372-4d1f43e57494'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:49:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f" returned: 0 in 0.853s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:04 devstack cinder-volume[92348]: DEBUG cinder.utils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Path /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0520b919-37d7-4cd1-8089-bcb6e20870f2 not found in is_blk_device check {{(pid=92348) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 16 08:49:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0520b919-37d7-4cd1-8089-bcb6e20870f2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:04 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0520b919-37d7-4cd1-8089-bcb6e20870f2 Jun 16 08:49:04 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:04 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:04 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:04 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:49:04 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:05 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.748s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:05 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:49:05 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] Deleted volume successfully. Jun 16 08:49:05 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:UPDATE=106,cinder:INSERT=29,cinder:SELECT=109,cinder:DELETE=11 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:49:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-76f60342-0cc9-4ab3-8d18-6eb49ae60cd5 tempest-VolumesDeleteCascade-200718758 None] Lock "cinder-bb1a1fbe-24a4-4460-b939-73923513be19-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:09 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:UPDATE=122,cinder:SELECT=111,cinder:DELETE=7,cinder:INSERT=32 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:49:09 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-60beb264-2368-4072-9689-222e8103fedf req-a1c47ce2-0d09-41a7-b9b8-196c6f25ae2f tempest-AttachVolumeTestJSON-1013321509 None] Terminate volume connection completed successfully. Jun 16 08:49:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-60beb264-2368-4072-9689-222e8103fedf req-a1c47ce2-0d09-41a7-b9b8-196c6f25ae2f tempest-AttachVolumeTestJSON-1013321509 None] Deleting attachment f454e83c-445a-48fd-8972-96328cb1b3fb. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:49:11 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0520b919-37d7-4cd1-8089-bcb6e20870f2" returned: 0 in 6.968s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:11 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a55dfe-c756-417d-93a3-5c5b50f677a6]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:11 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:49:11 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f Jun 16 08:49:11 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Flow 'volume_create_manager' (59c50097-c413-4c65-aee5-fae91abc6f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:49:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca563886-967a-45fd-a4a1-bf47543e286a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca563886-967a-45fd-a4a1-bf47543e286a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1593805718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22dde1d6-6679-4ad4-a78a-b5faebcd977f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a77ef9f76a40ba9a987362951b2f00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:49:11Z,use_quota=True,user_id='f441aa8ffdfd48c2b66d41f15d233a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3caa49d5-dbe7-4d93-9653-98b0fd5435c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3caa49d5-dbe7-4d93-9653-98b0fd5435c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78020b85-30d0-4779-b97e-cd81518af6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78020b85-30d0-4779-b97e-cd81518af6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22dde1d6-6679-4ad4-a78a-b5faebcd977f', 'volume_name': 'volume-22dde1d6-6679-4ad4-a78a-b5faebcd977f', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119be31b-481d-4f50-ab57-19a857c6c644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119be31b-481d-4f50-ab57-19a857c6c644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcad5f31-25e9-410c-a9c2-e38c5d7abbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:11 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Volume 22dde1d6-6679-4ad4-a78a-b5faebcd977f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22dde1d6-6679-4ad4-a78a-b5faebcd977f', 'volume_size': 1} Jun 16 08:49:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:12 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f" returned: 0 in 0.874s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:12 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f, size 1024.00 MB, duration 6.97 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0520b919-37d7-4cd1-8089-bcb6e20870f2 {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:49:12 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Converted 1024.00 MB image at 146.93 MB/s Jun 16 08:49:12 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0520b919-37d7-4cd1-8089-bcb6e20870f2 is being set with open permissions: ugo+rw Jun 16 08:49:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0520b919-37d7-4cd1-8089-bcb6e20870f2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:12 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0520b919-37d7-4cd1-8089-bcb6e20870f2 Jun 16 08:49:12 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:12 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0520b919-37d7-4cd1-8089-bcb6e20870f2" returned: 0 in 0.767s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-0520b919-37d7-4cd1-8089-bcb6e20870f2" released by "_copy_volume_from_snapshot" :: held 10.532s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-68fc8e35-6716-4f82-aa8f-e7d933ff599a-0520b919-37d7-4cd1-8089-bcb6e20870f2" released by "_create_volume_from_snapshot" :: held 10.611s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.647s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.447s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1593805718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22dde1d6-6679-4ad4-a78a-b5faebcd977f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a77ef9f76a40ba9a987362951b2f00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:49:11Z,use_quota=True,user_id='f441aa8ffdfd48c2b66d41f15d233a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:49:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Creating volume 22dde1d6-6679-4ad4-a78a-b5faebcd977f {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:49:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:49:12 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:49:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dde1d6-6679-4ad4-a78a-b5faebcd977f 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:13 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dde1d6-6679-4ad4-a78a-b5faebcd977f 1073741824 Jun 16 08:49:13 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:13 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b888f6-b0bc-4d75-a139-54044b4a8082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0520b919-37d7-4cd1-8089-bcb6e20870f2', 'volume_size': 2, 'snapshot_id': '68fc8e35-6716-4f82-aa8f-e7d933ff599a'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:13 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4644fdc-9bb2-4e1f-808f-14c09b21357e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:13 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Volume volume-0520b919-37d7-4cd1-8089-bcb6e20870f2 (0520b919-37d7-4cd1-8089-bcb6e20870f2): created successfully Jun 16 08:49:13 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4644fdc-9bb2-4e1f-808f-14c09b21357e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:13 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Flow 'volume_create_manager' (8f18af79-d3dc-4b9a-b51b-e2311b3e934e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:49:13 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-dda16000-db01-4e48-b123-82c18eb94d88 tempest-VolumesSnapshotTestJSON-2052748308 None] Created volume successfully. Jun 16 08:49:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-0520b919-37d7-4cd1-8089-bcb6e20870f2-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-0520b919-37d7-4cd1-8089-bcb6e20870f2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-quobyte-0520b919-37d7-4cd1-8089-bcb6e20870f2" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-0520b919-37d7-4cd1-8089-bcb6e20870f2" acquired by "delete_volume" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:13 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ee242f-254f-4b86-ac40-723fc27c5588]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0520b919-37d7-4cd1-8089-bcb6e20870f2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:13 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0520b919-37d7-4cd1-8089-bcb6e20870f2 Jun 16 08:49:13 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:13 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dde1d6-6679-4ad4-a78a-b5faebcd977f 1073741824" returned: 0 in 0.882s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dde1d6-6679-4ad4-a78a-b5faebcd977f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:13 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dde1d6-6679-4ad4-a78a-b5faebcd977f Jun 16 08:49:13 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:14 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0520b919-37d7-4cd1-8089-bcb6e20870f2" returned: 0 in 0.860s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0520b919-37d7-4cd1-8089-bcb6e20870f2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:14 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0520b919-37d7-4cd1-8089-bcb6e20870f2 Jun 16 08:49:14 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:14 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dde1d6-6679-4ad4-a78a-b5faebcd977f" returned: 0 in 0.756s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:14 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:49:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:14 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcad5f31-25e9-410c-a9c2-e38c5d7abbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22dde1d6-6679-4ad4-a78a-b5faebcd977f', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:14 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31ac01f-c9e6-4675-afd2-2aff5ddfe4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:14 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Volume volume-22dde1d6-6679-4ad4-a78a-b5faebcd977f (22dde1d6-6679-4ad4-a78a-b5faebcd977f): created successfully Jun 16 08:49:14 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31ac01f-c9e6-4675-afd2-2aff5ddfe4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:14 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Flow 'volume_create_manager' (59c50097-c413-4c65-aee5-fae91abc6f3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:49:14 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-020c62d4-a5ab-45ed-9000-4a37dd802cc8 tempest-VolumesMetadataTest-721534921 None] Created volume successfully. Jun 16 08:49:15 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0520b919-37d7-4cd1-8089-bcb6e20870f2" returned: 0 in 0.781s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-0520b919-37d7-4cd1-8089-bcb6e20870f2" released by "delete_volume" :: held 1.700s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:15 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] Created reservations ['72f36600-266d-479a-9716-3463f6ffb5cf', 'fc71c278-76d8-4ae5-84f0-46839d36da8a', '6b8b627d-e65d-4add-bc0d-b2a237fd8670', 'dc05bfd4-41bc-49c9-8b52-fa41dde46dc6'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:49:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:15 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:15 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:15 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:49:15 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-68fc8e35-6716-4f82-aa8f-e7d933ff599a-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-68fc8e35-6716-4f82-aa8f-e7d933ff599a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-quobyte-cfdcd399-0cc7-451b-beee-94fe0557407f" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-cfdcd399-0cc7-451b-beee-94fe0557407f" acquired by "delete_snapshot" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-quobyte-68fc8e35-6716-4f82-aa8f-e7d933ff599a" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-68fc8e35-6716-4f82-aa8f-e7d933ff599a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:15 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] Deleting offline snapshot 68fc8e35-6716-4f82-aa8f-e7d933ff599a of volume cfdcd399-0cc7-451b-beee-94fe0557407f {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:49:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] snapshot_file for this snap is: volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:49:16 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7755b0be-6650-4d7e-a717-c009ddfa90fc]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:16 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.815s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:16 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:49:16 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] Deleted volume successfully. Jun 16 08:49:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-83235da7-6116-4e24-a1d0-24ba2ddbadbc tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-0520b919-37d7-4cd1-8089-bcb6e20870f2-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:16 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a Jun 16 08:49:16 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] Acquiring lock "cinder-22dde1d6-6679-4ad4-a78a-b5faebcd977f-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] Lock "cinder-22dde1d6-6679-4ad4-a78a-b5faebcd977f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] Acquiring lock "cinder-quobyte-22dde1d6-6679-4ad4-a78a-b5faebcd977f" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] Lock "cinder-quobyte-22dde1d6-6679-4ad4-a78a-b5faebcd977f" acquired by "delete_volume" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:16 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff3ab24-f9e8-4e9c-8338-7c8089c92cc0]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dde1d6-6679-4ad4-a78a-b5faebcd977f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:16 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dde1d6-6679-4ad4-a78a-b5faebcd977f Jun 16 08:49:16 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:17 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a" returned: 0 in 1.141s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:17 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfdcd399-0cc7-451b-beee-94fe0557407f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:49:17 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7510d087-e4a3-4daa-9e94-615fe1f38824]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:17 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f Jun 16 08:49:17 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:17 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dde1d6-6679-4ad4-a78a-b5faebcd977f" returned: 0 in 0.776s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dde1d6-6679-4ad4-a78a-b5faebcd977f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:17 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dde1d6-6679-4ad4-a78a-b5faebcd977f Jun 16 08:49:17 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:17 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f" returned: 0 in 0.707s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:17 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a Jun 16 08:49:17 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:18 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-22dde1d6-6679-4ad4-a78a-b5faebcd977f" returned: 0 in 0.599s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:18 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] Lock "cinder-quobyte-22dde1d6-6679-4ad4-a78a-b5faebcd977f" released by "delete_volume" :: held 1.447s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:18 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] Created reservations ['36cf92e8-b3a4-455e-9f42-cd4cb879d116', '37c36ee9-caff-4a0f-bcdb-e2a31b452e4a', '381c72c6-8e9c-482f-9962-5fdd8da2647a', 'a7141a43-67db-4c84-8b04-fe83a8fa90bc'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:49:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:18 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:18 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:18 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:49:18 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:18 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a" returned: 0 in 0.794s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:18 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a Jun 16 08:49:18 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:18 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.635s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:18 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:49:18 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] Deleted volume successfully. Jun 16 08:49:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7bf310ab-2a0d-4ee1-94a6-9878d519a08e tempest-VolumesMetadataTest-721534921 None] Lock "cinder-22dde1d6-6679-4ad4-a78a-b5faebcd977f-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:19 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f.68fc8e35-6716-4f82-aa8f-e7d933ff599a" returned: 0 in 0.597s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-68fc8e35-6716-4f82-aa8f-e7d933ff599a" released by "_delete_snapshot" :: held 3.378s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-cfdcd399-0cc7-451b-beee-94fe0557407f" released by "delete_snapshot" :: held 3.401s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:19 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] Created reservations ['24bdec18-32e7-4b1b-b993-be9c4a79a3ac', '22884153-24c8-40eb-8831-f099a4e1f828', 'f49274af-bf0d-4edf-bca3-0b92ca4dd739', 'c0622fe5-07f5-4bc4-a73c-a56343308a45'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:49:19 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] Delete snapshot completed successfully. Jun 16 08:49:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5e6b6e4c-d87d-4b8f-a005-f86d969f792c tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-68fc8e35-6716-4f82-aa8f-e7d933ff599a-delete_snapshot" released by "delete_snapshot" :: held 3.567s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-cfdcd399-0cc7-451b-beee-94fe0557407f-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-cfdcd399-0cc7-451b-beee-94fe0557407f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-quobyte-cfdcd399-0cc7-451b-beee-94fe0557407f" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-cfdcd399-0cc7-451b-beee-94fe0557407f" acquired by "delete_volume" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:20 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ab288f-cc87-4ffa-a27f-563a4a55b939]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:20 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f Jun 16 08:49:20 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:21 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f" returned: 0 in 0.798s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:21 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f Jun 16 08:49:21 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Flow 'volume_create_manager' (c8b6a73b-d015-4c00-98a1-4c77eb30ef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c2ad39-eaee-436b-a550-9dd8221c330d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c2ad39-eaee-436b-a550-9dd8221c330d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1546516174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9998ac19-2051-4b9f-9f02-cfd4f3e99167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c222817299434170806e18498626b2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:49:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:49:22Z,use_quota=True,user_id='f62f7d91c07b4a0594a88bec0ded5ae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16e866b-2a86-4096-86f1-6157936f3fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16e866b-2a86-4096-86f1-6157936f3fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4090acff-a2f0-4a53-bc48-eb588e94b0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4090acff-a2f0-4a53-bc48-eb588e94b0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9998ac19-2051-4b9f-9f02-cfd4f3e99167', 'volume_name': 'volume-9998ac19-2051-4b9f-9f02-cfd4f3e99167', 'volume_size': 2}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893ca021-e329-43c1-9f51-aa46ec3c10fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893ca021-e329-43c1-9f51-aa46ec3c10fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2670d96d-dd0a-4872-87da-d00494c60b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:22 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Volume 9998ac19-2051-4b9f-9f02-cfd4f3e99167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9998ac19-2051-4b9f-9f02-cfd4f3e99167', 'volume_size': 2} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1546516174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9998ac19-2051-4b9f-9f02-cfd4f3e99167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c222817299434170806e18498626b2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:49:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:49:22Z,use_quota=True,user_id='f62f7d91c07b4a0594a88bec0ded5ae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Creating volume 9998ac19-2051-4b9f-9f02-cfd4f3e99167 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:49:22 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9998ac19-2051-4b9f-9f02-cfd4f3e99167 2147483648 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:22 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9998ac19-2051-4b9f-9f02-cfd4f3e99167 2147483648 Jun 16 08:49:22 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:22 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cfdcd399-0cc7-451b-beee-94fe0557407f" returned: 0 in 1.313s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-cfdcd399-0cc7-451b-beee-94fe0557407f" released by "delete_volume" :: held 2.213s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] Created reservations ['5be5dfa0-543e-484e-9cd5-dad92bbdaecd', '9646462a-b96d-4614-88a2-b4b485b817ec', '53f93290-4ed9-4bcb-9066-c74dd565a299', '1ea4236a-3e95-4da3-9e50-00092018bff0'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:22 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:49:22 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:24 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.342s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:24 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:49:24 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] Deleted volume successfully. Jun 16 08:49:24 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9998ac19-2051-4b9f-9f02-cfd4f3e99167 2147483648" returned: 0 in 1.907s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:24 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8c27ed54-f55a-46ea-9abf-ff85135f8b1b tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-cfdcd399-0cc7-451b-beee-94fe0557407f-delete_volume" released by "delete_volume" :: held 3.989s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9998ac19-2051-4b9f-9f02-cfd4f3e99167 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:24 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9998ac19-2051-4b9f-9f02-cfd4f3e99167 Jun 16 08:49:24 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Flow 'volume_create_manager' (15eb2721-b57a-4e1d-b3a0-dd21b17cd8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f27ecb-c2b9-4318-b4e0-1408c82b1022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f27ecb-c2b9-4318-b4e0-1408c82b1022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-892821661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d99b57cc-ba58-4514-9866-b8d73fa4f2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67112c8977d0413f81dcac4eac67d95d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:49:25Z,use_quota=True,user_id='e892f71d55e9458185b214ef03da8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7222af2e-d7a6-4dbc-a358-968e91ec7bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:25 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7222af2e-d7a6-4dbc-a358-968e91ec7bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f87999-0c8e-49ea-9e4d-63de0d82f214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f87999-0c8e-49ea-9e4d-63de0d82f214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd99b57cc-ba58-4514-9866-b8d73fa4f2ee', 'volume_name': 'volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21fb4d24-2584-4de2-8480-66d6f3913140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21fb4d24-2584-4de2-8480-66d6f3913140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b087c00d-8dd6-4f48-9529-dd1a477231fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:25 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Volume d99b57cc-ba58-4514-9866-b8d73fa4f2ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee', 'volume_size': 1} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9998ac19-2051-4b9f-9f02-cfd4f3e99167" returned: 0 in 1.043s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] <== create_volume: return (3082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.088s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-892821661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d99b57cc-ba58-4514-9866-b8d73fa4f2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67112c8977d0413f81dcac4eac67d95d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:49:25Z,use_quota=True,user_id='e892f71d55e9458185b214ef03da8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Creating volume d99b57cc-ba58-4514-9866-b8d73fa4f2ee {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:49:25 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2670d96d-dd0a-4872-87da-d00494c60b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9998ac19-2051-4b9f-9f02-cfd4f3e99167', 'volume_size': 2}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84102c50-2367-465e-a33b-440c6894b3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:25 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee 1073741824 Jun 16 08:49:25 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:25 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Volume volume-9998ac19-2051-4b9f-9f02-cfd4f3e99167 (9998ac19-2051-4b9f-9f02-cfd4f3e99167): created successfully Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84102c50-2367-465e-a33b-440c6894b3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Flow 'volume_create_manager' (c8b6a73b-d015-4c00-98a1-4c77eb30ef5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:49:25 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-15f73570-99fe-4372-b0f3-3f8c8121595d tempest-VolumesCloneNegativeTest-1478436234 None] Created volume successfully. Jun 16 08:49:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] Acquiring lock "cinder-9998ac19-2051-4b9f-9f02-cfd4f3e99167-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] Lock "cinder-9998ac19-2051-4b9f-9f02-cfd4f3e99167-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] Acquiring lock "cinder-quobyte-9998ac19-2051-4b9f-9f02-cfd4f3e99167" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] Lock "cinder-quobyte-9998ac19-2051-4b9f-9f02-cfd4f3e99167" acquired by "delete_volume" :: waited 0.036s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:26 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[406c4ad7-86b6-49a5-93a9-5e7fe5947cb2]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9998ac19-2051-4b9f-9f02-cfd4f3e99167 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:26 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9998ac19-2051-4b9f-9f02-cfd4f3e99167 Jun 16 08:49:26 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:27 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee 1073741824" returned: 0 in 1.617s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:27 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee Jun 16 08:49:27 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:27 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9998ac19-2051-4b9f-9f02-cfd4f3e99167" returned: 0 in 1.255s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9998ac19-2051-4b9f-9f02-cfd4f3e99167 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:27 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9998ac19-2051-4b9f-9f02-cfd4f3e99167 Jun 16 08:49:27 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:28 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee" returned: 0 in 1.250s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] <== create_volume: return (2945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:49:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.959s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b087c00d-8dd6-4f48-9529-dd1a477231fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362b97b9-6a58-4321-8155-76eb8bd9c756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:28 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Volume volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee (d99b57cc-ba58-4514-9866-b8d73fa4f2ee): created successfully Jun 16 08:49:28 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362b97b9-6a58-4321-8155-76eb8bd9c756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Flow 'volume_create_manager' (15eb2721-b57a-4e1d-b3a0-dd21b17cd8de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:49:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9998ac19-2051-4b9f-9f02-cfd4f3e99167" returned: 0 in 0.769s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:28 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] Lock "cinder-quobyte-9998ac19-2051-4b9f-9f02-cfd4f3e99167" released by "delete_volume" :: held 2.123s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c2b192e6-55a5-48a2-a2bf-1a7b3f21ea91 tempest-VolumesSnapshotTestJSON-2052748308 None] Created volume successfully. Jun 16 08:49:28 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] Created reservations ['36bbaa20-fcde-4e55-afe6-d2ca856770a9', '606abb5d-8cc4-4b8c-b8a1-c01216809bbc', '1b0532cd-711f-4974-904b-ebb4cd8f34e4', '2a875625-1da2-4727-bf87-ddd09397b352'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:49:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:28 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:49:28 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:29 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.604s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:29 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:49:29 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] Deleted volume successfully. Jun 16 08:49:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b3240c76-51b7-45a0-86e7-60086576d9c7 tempest-VolumesCloneNegativeTest-1478436234 None] Lock "cinder-9998ac19-2051-4b9f-9f02-cfd4f3e99167-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:29 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] Creating offline snapshot b933d972-9a32-4d91-81d6-c92809f4bc87 of volume d99b57cc-ba58-4514-9866-b8d73fa4f2ee {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:49:29 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6b6288-444e-4667-ac28-51ae735a2f96]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:30 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee Jun 16 08:49:30 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:49:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:30 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:49:30 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:31 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee" returned: 0 in 1.211s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:31 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.024s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:31 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:49:31 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:49:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:49:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:49:31 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87 1G Jun 16 08:49:31 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:32 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87 1G" returned: 0 in 1.233s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:32 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87 Jun 16 08:49:32 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:33 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87" returned: 0 in 0.826s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:33 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87 is being set with open permissions: ugo+rw Jun 16 08:49:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:33 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87 Jun 16 08:49:33 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:33 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87" returned: 0 in 0.717s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:34 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.info Jun 16 08:49:34 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:34 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:49:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Flow 'volume_create_manager' (15fd94da-46d6-43fe-b3fd-cb1ab62bbab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:49:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65698ec6-8152-413f-abba-c9f578a3d0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65698ec6-8152-413f-abba-c9f578a3d0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1046445697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c54c499-4d2d-4186-ba1e-4f6b6902d405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5f9b751fe2448749133f38af152d7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:49:34Z,use_quota=True,user_id='1c707a7663a345d099da5c3080465806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43347a3d-8886-4eb3-adb9-d9ad40b247aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43347a3d-8886-4eb3-adb9-d9ad40b247aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38332828-ab2c-4005-8423-3bfbc5d04303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:34 devstack cinder-volume[92348]: DEBUG cinder.image.glance [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Creating Keystone auth plugin from conf {{(pid=92348) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 16 08:49:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38332828-ab2c-4005-8423-3bfbc5d04303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c54c499-4d2d-4186-ba1e-4f6b6902d405', 'volume_name': 'volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405', 'volume_size': 1, 'image_id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '038e50e6f4094f25b7da1abcd3989b23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'created_at': datetime.datetime(2026, 6, 16, 6, 33, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 34, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7b8ae3-df58-4ade-b7dd-4eb5ec16b4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:34 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7b8ae3-df58-4ade-b7dd-4eb5ec16b4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75d2cb1-a981-4023-9cb6-458ebb7bb849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:34 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Volume 8c54c499-4d2d-4186-ba1e-4f6b6902d405: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405', 'volume_size': 1, 'image_id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '038e50e6f4094f25b7da1abcd3989b23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'created_at': datetime.datetime(2026, 6, 16, 6, 33, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 34, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 16 08:49:34 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Trying to clone 8c54c499-4d2d-4186-ba1e-4f6b6902d405 from image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}]). {{(pid=92348) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 16 08:49:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.info" returned: 0 in 0.724s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:34 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.info is being set with open permissions: ugo+rw Jun 16 08:49:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:34 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.info Jun 16 08:49:34 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:35 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_1vqcbst0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 16 08:49:35 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Image download 20.69 MB at 20.69 MB/s Jun 16 08:49:35 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44ce97e-097a-41ca-8e99-e669fb9fc948]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_1vqcbst0devstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:35 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_1vqcbst0devstack@QuobyteHD Jun 16 08:49:35 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:35 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.info" returned: 0 in 1.118s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.951s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:35 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-cb268372-d324-4cad-896b-c9de750a2673 tempest-VolumesSnapshotTestJSON-2052748308 None] Create snapshot completed successfully Jun 16 08:49:36 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_1vqcbst0devstack@QuobyteHD" returned: 0 in 0.795s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:36 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Temporary image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec is fetched for user 1c707a7663a345d099da5c3080465806. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 16 08:49:36 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d88134-dfca-480d-8f19-2a1fd219d724]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_1vqcbst0devstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:36 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_1vqcbst0devstack@QuobyteHD Jun 16 08:49:36 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:49:37 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Flow 'volume_create_manager' (67987c9b-e7c4-44a3-853b-c2e25a9e15a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089b5e2c-1da5-475c-baf2-34b351e6f7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_1vqcbst0devstack@QuobyteHD" returned: 0 in 0.830s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1046445697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c54c499-4d2d-4186-ba1e-4f6b6902d405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5f9b751fe2448749133f38af152d7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:49:34Z,use_quota=True,user_id='1c707a7663a345d099da5c3080465806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Creating volume 8c54c499-4d2d-4186-ba1e-4f6b6902d405 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:49:37 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:37 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 1073741824 Jun 16 08:49:37 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089b5e2c-1da5-475c-baf2-34b351e6f7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-466264678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bae0f18-2dfb-4775-9d4a-32bf1567bb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67112c8977d0413f81dcac4eac67d95d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b933d972-9a32-4d91-81d6-c92809f4bc87,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:49:37Z,use_quota=True,user_id='e892f71d55e9458185b214ef03da8cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d6e098-abfb-4724-b52a-0c1ecb5e0f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d6e098-abfb-4724-b52a-0c1ecb5e0f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c295744-a4e8-458f-b56b-03170dae01ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c295744-a4e8-458f-b56b-03170dae01ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3bae0f18-2dfb-4775-9d4a-32bf1567bb67', 'volume_name': 'volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67', 'volume_size': 1, 'snapshot_id': 'b933d972-9a32-4d91-81d6-c92809f4bc87'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a29fab9-0f0c-4260-b85b-106eefb43ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a29fab9-0f0c-4260-b85b-106eefb43ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8a5ff7-f183-485a-ae4d-43d7b87acd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:37 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Volume 3bae0f18-2dfb-4775-9d4a-32bf1567bb67: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67', 'volume_size': 1, 'snapshot_id': 'b933d972-9a32-4d91-81d6-c92809f4bc87'} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:37 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 1073741824" returned: 0 in 0.777s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:37 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 Jun 16 08:49:37 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:38 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405" returned: 0 in 0.622s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.347s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-quobyte-b933d972-9a32-4d91-81d6-c92809f4bc87-3bae0f18-2dfb-4775-9d4a-32bf1567bb67" by "_create_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-b933d972-9a32-4d91-81d6-c92809f4bc87-3bae0f18-2dfb-4775-9d4a-32bf1567bb67" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Creating volume 3bae0f18-2dfb-4775-9d4a-32bf1567bb67 from snapshot b933d972-9a32-4d91-81d6-c92809f4bc87 {{(pid=92348) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-quobyte-3bae0f18-2dfb-4775-9d4a-32bf1567bb67" by "_copy_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-3bae0f18-2dfb-4775-9d4a-32bf1567bb67" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] snapshot: b933d972-9a32-4d91-81d6-c92809f4bc87, volume: 3bae0f18-2dfb-4775-9d4a-32bf1567bb67, {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Attempting download of 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec ((None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}])) to volume 8c54c499-4d2d-4186-ba1e-4f6b6902d405. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[78af5c87-1ca5-4ed6-a5dc-f63910c51e1d]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2969a6-cd32-4484-83ab-9fc714a48d25]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_tqz9ltpe {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:38 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87 Jun 16 08:49:38 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:38 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_tqz9ltpe Jun 16 08:49:38 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:39 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_tqz9ltpe" returned: 0 in 0.682s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_tqz9ltpe {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:39 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87" returned: 0 in 0.729s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:49:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 16 08:49:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Creating direct copy from snapshot {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 16 08:49:39 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1904a9-c158-464a-92f4-7b9511a625eb]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:39 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_tqz9ltpe Jun 16 08:49:39 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:39 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee Jun 16 08:49:39 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:40 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_tqz9ltpe" returned: 1 in 0.652s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_tqz9ltpe' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:49:40 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7f4fe2-5066-4584-9e95-24aef0e64f21]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_1vqcbst0devstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:40 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee" returned: 0 in 0.716s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:40 devstack cinder-volume[92348]: DEBUG cinder.utils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Path /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67 not found in is_blk_device check {{(pid=92348) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 16 08:49:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:40 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_1vqcbst0devstack@QuobyteHD Jun 16 08:49:40 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:40 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67 Jun 16 08:49:40 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:40 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_1vqcbst0devstack@QuobyteHD" returned: 0 in 0.700s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:40 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec was qcow2, converting to raw {{(pid=92348) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 16 08:49:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_1vqcbst0devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:40 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_1vqcbst0devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 Jun 16 08:49:40 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:44 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_1vqcbst0devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405" returned: 0 in 3.377s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:44 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_1vqcbst0devstack@QuobyteHD, size 112.00 MB, duration 3.38 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:49:44 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Converted 112.00 MB image at 33.15 MB/s Jun 16 08:49:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:44 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 1G Jun 16 08:49:44 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:45 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67" returned: 0 in 5.182s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:45 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced87d73-763d-4e3c-b11e-916f0ac93a0d]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 1G" returned: 0 in 1.291s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:45 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:45 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee Jun 16 08:49:45 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:45 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dea6a73-99ac-40a5-b6bf-0b96d0cd9637]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:45 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 Jun 16 08:49:45 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:46 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee" returned: 0 in 0.983s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:46 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee, size 1024.00 MB, duration 5.18 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67 {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:49:46 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Converted 1024.00 MB image at 197.56 MB/s Jun 16 08:49:46 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67 is being set with open permissions: ugo+rw Jun 16 08:49:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:46 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405" returned: 0 in 0.886s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:46 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67 Jun 16 08:49:46 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:46 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 Jun 16 08:49:46 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:47 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67" returned: 0 in 0.722s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-3bae0f18-2dfb-4775-9d4a-32bf1567bb67" released by "_copy_volume_from_snapshot" :: held 8.446s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-b933d972-9a32-4d91-81d6-c92809f4bc87-3bae0f18-2dfb-4775-9d4a-32bf1567bb67" released by "_create_volume_from_snapshot" :: held 8.490s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.514s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8a5ff7-f183-485a-ae4d-43d7b87acd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67', 'volume_size': 1, 'snapshot_id': 'b933d972-9a32-4d91-81d6-c92809f4bc87'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82926f78-3290-430b-baa2-ccddc7d220a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:47 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Volume volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67 (3bae0f18-2dfb-4775-9d4a-32bf1567bb67): created successfully Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82926f78-3290-430b-baa2-ccddc7d220a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Flow 'volume_create_manager' (67987c9b-e7c4-44a3-853b-c2e25a9e15a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:49:47 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405" returned: 1 in 0.807s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Downloaded image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec ((None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}])) to volume 8c54c499-4d2d-4186-ba1e-4f6b6902d405 successfully. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Temporary image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec for user 1c707a7663a345d099da5c3080465806 is deleted. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Marking volume 8c54c499-4d2d-4186-ba1e-4f6b6902d405 as bootable. {{(pid=92348) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 16 08:49:47 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-e7e9fdf0-8515-494a-aaef-434af4890e67 tempest-VolumesSnapshotTestJSON-2052748308 None] Created volume successfully. Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Copying metadata from image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec to 8c54c499-4d2d-4186-ba1e-4f6b6902d405. {{(pid=92348) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Creating volume glance metadata for volume 8c54c499-4d2d-4186-ba1e-4f6b6902d405 backed by image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92348) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75d2cb1-a981-4023-9cb6-458ebb7bb849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405', 'volume_size': 1, 'image_id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '038e50e6f4094f25b7da1abcd3989b23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'created_at': datetime.datetime(2026, 6, 16, 6, 33, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 34, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e45e23-bb88-4ce7-91c6-2d4cce71865d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:47 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Volume volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 (8c54c499-4d2d-4186-ba1e-4f6b6902d405): created successfully Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e45e23-bb88-4ce7-91c6-2d4cce71865d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Flow 'volume_create_manager' (15fd94da-46d6-43fe-b3fd-cb1ab62bbab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:49:47 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-f6f33e8d-3025-4ddc-886a-5d3fac27c775 tempest-VolumesExtendTest-1321754475 None] Created volume successfully. Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-99fe7d9a-f9c1-4b6c-989b-a9a698353201 tempest-VolumesExtendTest-1321754475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-99fe7d9a-f9c1-4b6c-989b-a9a698353201 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5acfb7c-95cb-4120-9218-246c323ab552]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-99fe7d9a-f9c1-4b6c-989b-a9a698353201 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:47 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 Jun 16 08:49:47 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-3bae0f18-2dfb-4775-9d4a-32bf1567bb67-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-3bae0f18-2dfb-4775-9d4a-32bf1567bb67-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-quobyte-3bae0f18-2dfb-4775-9d4a-32bf1567bb67" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-3bae0f18-2dfb-4775-9d4a-32bf1567bb67" acquired by "delete_volume" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:48 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ae5bf8-2988-46f2-afbf-01afd0662c80]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:48 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67 Jun 16 08:49:48 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:48 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-99fe7d9a-f9c1-4b6c-989b-a9a698353201 tempest-VolumesExtendTest-1321754475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405" returned: 0 in 0.824s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-99fe7d9a-f9c1-4b6c-989b-a9a698353201 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:48 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 Jun 16 08:49:48 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:49 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67" returned: 0 in 0.808s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:49 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67 Jun 16 08:49:49 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:49 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-99fe7d9a-f9c1-4b6c-989b-a9a698353201 tempest-VolumesExtendTest-1321754475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405" returned: 1 in 0.931s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-99fe7d9a-f9c1-4b6c-989b-a9a698353201 tempest-VolumesExtendTest-1321754475 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-99fe7d9a-f9c1-4b6c-989b-a9a698353201 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 2G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-99fe7d9a-f9c1-4b6c-989b-a9a698353201 tempest-VolumesExtendTest-1321754475 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 2G" returned: 0 in 0.112s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-99fe7d9a-f9c1-4b6c-989b-a9a698353201 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.922s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Flow 'volume_create_manager' (18f4d50e-2143-4984-9908-dfab174ea775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f62b24d-c097-4f5a-b278-a2e3814efac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:49 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-99fe7d9a-f9c1-4b6c-989b-a9a698353201 tempest-VolumesExtendTest-1321754475 None] Extend volume completed successfully. Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f62b24d-c097-4f5a-b278-a2e3814efac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-477028084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ccacfd6d56049e795973a0509e8d2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:49:49Z,use_quota=True,user_id='a047716d6eec4b8f85d7f68882dc27e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a937ab-36f1-4412-a914-a3934710db4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a937ab-36f1-4412-a914-a3934710db4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978ec064-23e2-4df8-a694-5df127cde5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978ec064-23e2-4df8-a694-5df127cde5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7', 'volume_name': 'volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3d02ab-5d41-4658-8220-01a3144feaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3d02ab-5d41-4658-8220-01a3144feaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d299dac-c6c3-48e8-9ca4-d6a4572314a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:49 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Volume ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7', 'volume_size': 1} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-477028084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ccacfd6d56049e795973a0509e8d2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:49:49Z,use_quota=True,user_id='a047716d6eec4b8f85d7f68882dc27e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Creating volume ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:49:49 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:49 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7 1073741824 Jun 16 08:49:49 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:49 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bae0f18-2dfb-4775-9d4a-32bf1567bb67" returned: 0 in 0.927s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:49 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-3bae0f18-2dfb-4775-9d4a-32bf1567bb67" released by "delete_volume" :: held 1.821s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] Created reservations ['92602568-e084-43f8-9f80-ab2ee7d66a89', '48f85a0a-dca1-4576-9e6f-e8208bd0929d', '8f897fcc-5f92-4807-b967-7630a95e3626', 'f9347d5a-3bad-4565-a70a-751abdadee18'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Acquiring lock "cinder-8c54c499-4d2d-4186-ba1e-4f6b6902d405-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Lock "cinder-8c54c499-4d2d-4186-ba1e-4f6b6902d405-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:50 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:49:50 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Acquiring lock "cinder-quobyte-8c54c499-4d2d-4186-ba1e-4f6b6902d405" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Lock "cinder-quobyte-8c54c499-4d2d-4186-ba1e-4f6b6902d405" acquired by "delete_volume" :: waited 0.020s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6027d7d2-3a92-4e9f-a19b-e94a484ffca1]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:50 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 Jun 16 08:49:50 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-b933d972-9a32-4d91-81d6-c92809f4bc87-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-b933d972-9a32-4d91-81d6-c92809f4bc87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-quobyte-d99b57cc-ba58-4514-9866-b8d73fa4f2ee" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-d99b57cc-ba58-4514-9866-b8d73fa4f2ee" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-quobyte-b933d972-9a32-4d91-81d6-c92809f4bc87" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-b933d972-9a32-4d91-81d6-c92809f4bc87" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] Deleting offline snapshot b933d972-9a32-4d91-81d6-c92809f4bc87 of volume d99b57cc-ba58-4514-9866-b8d73fa4f2ee {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] snapshot_file for this snap is: volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afbaa18-a3a0-4768-a3eb-4fa978d518d8]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:50 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87 Jun 16 08:49:50 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:50 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7 1073741824" returned: 0 in 1.147s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:50 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.703s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:49:50 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] Deleted volume successfully. Jun 16 08:49:50 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7 Jun 16 08:49:50 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ee7eedf6-016f-443c-b522-be41d3376770 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-3bae0f18-2dfb-4775-9d4a-32bf1567bb67-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:51 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405" returned: 0 in 1.081s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:51 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 Jun 16 08:49:51 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:51 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87" returned: 0 in 1.120s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:49:51 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a04fd5-1b98-4d69-9b32-4a5414248e16]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:51 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7" returned: 0 in 1.020s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] <== create_volume: return (2227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:49:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.232s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:51 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee Jun 16 08:49:51 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d299dac-c6c3-48e8-9ca4-d6a4572314a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07b1b79-6808-48bb-991a-398067f58bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:51 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Volume volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7 (ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7): created successfully Jun 16 08:49:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07b1b79-6808-48bb-991a-398067f58bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Flow 'volume_create_manager' (18f4d50e-2143-4984-9908-dfab174ea775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:49:51 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-89cc4c77-4b66-4229-90d6-888483572a02 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Created volume successfully. Jun 16 08:49:52 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405" returned: 1 in 0.848s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:49:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:52 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405 Jun 16 08:49:52 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:52 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee" returned: 0 in 0.765s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:52 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87 Jun 16 08:49:52 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:52 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8c54c499-4d2d-4186-ba1e-4f6b6902d405" returned: 0 in 0.652s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Lock "cinder-quobyte-8c54c499-4d2d-4186-ba1e-4f6b6902d405" released by "delete_volume" :: held 2.648s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:52 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Created reservations ['e8dbe3e9-6ce0-46bc-8063-1cc47c57c73a', '498d3241-64cc-42df-86f7-f44aea2e6f1b', 'da91e7ec-ca53-4c13-884d-103a3322f5f1', '3adbd379-9ef1-4164-a0b7-50d1fb7ce685'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:53 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:49:53 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:53 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87" returned: 0 in 0.713s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:53 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87 Jun 16 08:49:53 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:53 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.626s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:49:53 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Deleted volume successfully. Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fe24070f-5c46-42c1-926d-d8d92c684f20 tempest-VolumesExtendTest-1321754475 None] Lock "cinder-8c54c499-4d2d-4186-ba1e-4f6b6902d405-delete_volume" released by "delete_volume" :: held 3.531s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:49:53 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Flow 'volume_create_manager' (5bdf15ae-b54c-4d2e-b358-d3f17e509c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e7a6e6-5530-4179-bc9a-073c90654f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee.b933d972-9a32-4d91-81d6-c92809f4bc87" returned: 0 in 0.662s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e7a6e6-5530-4179-bc9a-073c90654f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-166507246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569d1900-5d21-4c97-8fde-8a2b6e058ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5f9b751fe2448749133f38af152d7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:49:54Z,use_quota=True,user_id='1c707a7663a345d099da5c3080465806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b5dc1a-9333-483c-9d39-20b08714d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b5dc1a-9333-483c-9d39-20b08714d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc283f58-03b8-4996-959f-df902c17d29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc283f58-03b8-4996-959f-df902c17d29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '569d1900-5d21-4c97-8fde-8a2b6e058ee4', 'volume_name': 'volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23019a6f-3717-4d89-9126-f57fb08e6912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23019a6f-3717-4d89-9126-f57fb08e6912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822b381d-922e-499a-afa9-c8101926401b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:53 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Volume 569d1900-5d21-4c97-8fde-8a2b6e058ee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4', 'volume_size': 1} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-166507246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569d1900-5d21-4c97-8fde-8a2b6e058ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5f9b751fe2448749133f38af152d7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:49:54Z,use_quota=True,user_id='1c707a7663a345d099da5c3080465806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Creating volume 569d1900-5d21-4c97-8fde-8a2b6e058ee4 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:49:53 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:49:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:53 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 1073741824 Jun 16 08:49:53 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-b933d972-9a32-4d91-81d6-c92809f4bc87" released by "_delete_snapshot" :: held 3.451s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-d99b57cc-ba58-4514-9866-b8d73fa4f2ee" released by "delete_snapshot" :: held 3.484s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:54 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] Created reservations ['acefaac2-6a04-4a6c-b73b-cd8d02d5f687', '79c3908d-4c6d-4da0-87c1-b1b633ffa717', '41dcd772-5506-4fde-9e08-ca5643c50efb', '98515bd3-07bb-42b0-bda2-45af9116545d'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:49:54 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] Delete snapshot completed successfully. Jun 16 08:49:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-53ded203-29fb-47c1-8381-332bbe9b8c09 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-b933d972-9a32-4d91-81d6-c92809f4bc87-delete_snapshot" released by "delete_snapshot" :: held 3.618s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:54 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 1073741824" returned: 0 in 0.784s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:54 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 Jun 16 08:49:54 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-d99b57cc-ba58-4514-9866-b8d73fa4f2ee-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-d99b57cc-ba58-4514-9866-b8d73fa4f2ee-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-quobyte-d99b57cc-ba58-4514-9866-b8d73fa4f2ee" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-d99b57cc-ba58-4514-9866-b8d73fa4f2ee" acquired by "delete_volume" :: waited 0.039s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:55 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d87489-4739-4767-9658-00066f9d0166]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:55 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee Jun 16 08:49:55 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:55 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4" returned: 0 in 0.638s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:49:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822b381d-922e-499a-afa9-c8101926401b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4264270a-c494-4c30-8113-5723ba12a10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:49:55 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Volume volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 (569d1900-5d21-4c97-8fde-8a2b6e058ee4): created successfully Jun 16 08:49:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4264270a-c494-4c30-8113-5723ba12a10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:49:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Flow 'volume_create_manager' (5bdf15ae-b54c-4d2e-b358-d3f17e509c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:49:55 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-0f8ad2a0-6b73-44e2-8b2b-f29d621ddcb5 tempest-VolumesExtendTest-1321754475 None] Created volume successfully. Jun 16 08:49:55 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee" returned: 0 in 0.744s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:55 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee Jun 16 08:49:55 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-c2774c5a-5aa7-4497-9963-c86bee5b6150 req-a6d4ad69-90bd-40cd-8984-a655d425cc1f tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-c2774c5a-5aa7-4497-9963-c86bee5b6150 req-a6d4ad69-90bd-40cd-8984-a655d425cc1f tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:56 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a678004a-7c30-4c02-8003-fb6818fb748d]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-c2774c5a-5aa7-4497-9963-c86bee5b6150 req-a6d4ad69-90bd-40cd-8984-a655d425cc1f tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:56 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7 Jun 16 08:49:56 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:56 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d99b57cc-ba58-4514-9866-b8d73fa4f2ee" returned: 0 in 0.738s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-d99b57cc-ba58-4514-9866-b8d73fa4f2ee" released by "delete_volume" :: held 1.573s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:56 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] Created reservations ['d0a79e05-e10b-4514-90c9-8d514f4199ad', 'c276d357-db32-4ac3-8de5-a2eea067ea98', '6e6d6f8a-976e-4926-bf4d-21b87b54f534', 'e08e1f21-0649-407d-904a-8278a029edfe'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:49:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:56 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:49:56 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:57 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-c2774c5a-5aa7-4497-9963-c86bee5b6150 req-a6d4ad69-90bd-40cd-8984-a655d425cc1f tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7" returned: 0 in 0.893s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-c2774c5a-5aa7-4497-9963-c86bee5b6150 req-a6d4ad69-90bd-40cd-8984-a655d425cc1f tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.922s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.667s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] Creating offline snapshot ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 of volume 569d1900-5d21-4c97-8fde-8a2b6e058ee4 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:49:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-c2774c5a-5aa7-4497-9963-c86bee5b6150 req-a6d4ad69-90bd-40cd-8984-a655d425cc1f tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7531f6ba-180b-4b96-afcb-fe6cf62f52db', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:49:57 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa55aac-8bec-41f4-9e3d-5446c7689115]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-c463d4ca-9f05-4a03-8ae3-7efe260c31c2-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-c463d4ca-9f05-4a03-8ae3-7efe260c31c2-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:57 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-c2774c5a-5aa7-4497-9963-c86bee5b6150 req-a6d4ad69-90bd-40cd-8984-a655d425cc1f tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] attachment_update completed successfully. Jun 16 08:49:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "cinder-quobyte-c463d4ca-9f05-4a03-8ae3-7efe260c31c2" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:49:57 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 Jun 16 08:49:57 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-c463d4ca-9f05-4a03-8ae3-7efe260c31c2" acquired by "delete_volume" :: waited 0.025s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:49:57 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff9ad91-3b59-4e52-8bc3-5dfb9cad5226]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:49:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:57 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.813s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:57 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:49:57 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] Deleted volume successfully. Jun 16 08:49:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c0dac019-97cd-4a80-926c-9c8390839982 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-d99b57cc-ba58-4514-9866-b8d73fa4f2ee-delete_volume" released by "delete_volume" :: held 2.672s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:57 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2 Jun 16 08:49:57 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:58 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4" returned: 0 in 0.943s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:58 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 1G Jun 16 08:49:58 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:58 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2" returned: 0 in 0.874s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:58 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2 Jun 16 08:49:58 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:59 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 1G" returned: 0 in 1.033s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:59 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 Jun 16 08:49:59 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:59 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c463d4ca-9f05-4a03-8ae3-7efe260c31c2" returned: 0 in 0.930s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:59 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-quobyte-c463d4ca-9f05-4a03-8ae3-7efe260c31c2" released by "delete_volume" :: held 1.886s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:49:59 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] Created reservations ['018dd306-ea8e-4daa-bd95-f1d46d6ec09c', '807fe111-e156-4f3e-af6d-a3499a86196e', '296ef830-13b3-4ed9-a253-c0890788705d', 'bd509e2c-9ee8-4eeb-881c-fb63bd6b569d'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:49:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:49:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:49:59 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:49:59 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:49:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:49:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:49:59 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:49:59 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:49:59 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Jun 16 08:49:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3" returned: 0 in 0.869s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:49:59 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 is being set with open permissions: ugo+rw Jun 16 08:49:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:00 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 Jun 16 08:50:00 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:00 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.854s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:00 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:50:00 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] Deleted volume successfully. Jun 16 08:50:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3d37d889-eb9f-421f-ac6c-0e2be9998596 tempest-VolumesSnapshotTestJSON-2052748308 None] Lock "cinder-c463d4ca-9f05-4a03-8ae3-7efe260c31c2-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:00 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3" returned: 0 in 0.766s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:00 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.info Jun 16 08:50:00 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:01 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.info" returned: 0 in 0.706s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:01 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.info is being set with open permissions: ugo+rw Jun 16 08:50:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:01 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.info Jun 16 08:50:01 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:02 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.info" returned: 0 in 0.641s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.148s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:02 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-39430100-673c-4ac9-b91d-639cd7e17be4 tempest-VolumesExtendTest-1321754475 None] Create snapshot completed successfully Jun 16 08:50:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-576e5217-44dc-48c3-a0f5-cf4da693a9e0 tempest-VolumesExtendTest-1321754475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-576e5217-44dc-48c3-a0f5-cf4da693a9e0 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:02 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72c9327-8687-42a8-bdb4-089fcd287be1]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:50:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-576e5217-44dc-48c3-a0f5-cf4da693a9e0 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:03 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 Jun 16 08:50:03 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:03 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-576e5217-44dc-48c3-a0f5-cf4da693a9e0 tempest-VolumesExtendTest-1321754475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4" returned: 0 in 0.879s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-576e5217-44dc-48c3-a0f5-cf4da693a9e0 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 2G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-576e5217-44dc-48c3-a0f5-cf4da693a9e0 tempest-VolumesExtendTest-1321754475 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 2G" returned: 0 in 0.183s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-576e5217-44dc-48c3-a0f5-cf4da693a9e0 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.119s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:04 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-576e5217-44dc-48c3-a0f5-cf4da693a9e0 tempest-VolumesExtendTest-1321754475 None] Extend volume completed successfully. Jun 16 08:50:04 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-66bcdc65-cf50-44c3-a24c-4a8841ce5fe5 req-020486ed-d6ca-469d-8112-d5eefa9162db tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Terminate volume connection completed successfully. Jun 16 08:50:04 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-66bcdc65-cf50-44c3-a24c-4a8841ce5fe5 req-020486ed-d6ca-469d-8112-d5eefa9162db tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Deleting attachment 7531f6ba-180b-4b96-afcb-fe6cf62f52db. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:50:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] Acquiring lock "cinder-ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] Lock "cinder-ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] Acquiring lock "cinder-quobyte-569d1900-5d21-4c97-8fde-8a2b6e058ee4" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] Lock "cinder-quobyte-569d1900-5d21-4c97-8fde-8a2b6e058ee4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] Acquiring lock "cinder-quobyte-ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] Lock "cinder-quobyte-ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] Deleting offline snapshot ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 of volume 569d1900-5d21-4c97-8fde-8a2b6e058ee4 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:50:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] snapshot_file for this snap is: volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:50:05 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[431310b0-b08b-4043-b12f-02e635f26354]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:50:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:05 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 Jun 16 08:50:05 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:06 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3" returned: 0 in 0.770s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32c5408-718e-433a-9b3c-0e6c06a75224]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=87,cinder:UPDATE=101,cinder:DELETE=9,cinder:INSERT=34 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Flow 'volume_create_manager' (81583690-6507-4bc0-ba1a-d156e653ca8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4712838-e324-4f56-9c47-8cc0a71ca57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:06 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 Jun 16 08:50:06 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4712838-e324-4f56-9c47-8cc0a71ca57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-982711096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60683973-3e02-4914-a23b-56c3950a786f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3058a1432a48328e8c3428803d71e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:50:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:50:06Z,use_quota=True,user_id='92cf0c0204e84777b0bf075762c8bac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20d782a-9d14-43af-9263-36190a6185bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20d782a-9d14-43af-9263-36190a6185bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ba74a7-6dac-4bd3-bce7-ace24a892489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ba74a7-6dac-4bd3-bce7-ace24a892489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60683973-3e02-4914-a23b-56c3950a786f', 'volume_name': 'volume-60683973-3e02-4914-a23b-56c3950a786f', 'volume_size': 2}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed7c146-e2e4-46b7-906b-7b01f46319c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed7c146-e2e4-46b7-906b-7b01f46319c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af26ddef-a25c-4319-b600-4b287aa1b3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:06 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Volume 60683973-3e02-4914-a23b-56c3950a786f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60683973-3e02-4914-a23b-56c3950a786f', 'volume_size': 2} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-982711096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60683973-3e02-4914-a23b-56c3950a786f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3058a1432a48328e8c3428803d71e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:50:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:50:06Z,use_quota=True,user_id='92cf0c0204e84777b0bf075762c8bac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Creating volume 60683973-3e02-4914-a23b-56c3950a786f {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:50:06 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:50:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f 2147483648 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:06 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f 2147483648 Jun 16 08:50:06 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:07 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4" returned: 0 in 1.008s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:07 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 Jun 16 08:50:07 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Acquiring lock "cinder-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Lock "cinder-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Acquiring lock "cinder-quobyte-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Lock "cinder-quobyte-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7" acquired by "delete_volume" :: waited 0.036s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:07 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b582fd6-57c3-4549-9d63-955d4dcb5e01]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:50:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:07 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7 Jun 16 08:50:07 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:07 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f 2147483648" returned: 0 in 1.216s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:07 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f Jun 16 08:50:07 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:08 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3" returned: 0 in 1.033s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:08 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3 Jun 16 08:50:08 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:08 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7" returned: 0 in 0.916s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:08 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7 Jun 16 08:50:08 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:08 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f" returned: 0 in 0.851s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:08 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] <== create_volume: return (2142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:50:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.148s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:08 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af26ddef-a25c-4319-b600-4b287aa1b3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60683973-3e02-4914-a23b-56c3950a786f', 'volume_size': 2}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:08 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c6e549-f325-4fb6-9bee-d4b094dfe9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:08 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Volume volume-60683973-3e02-4914-a23b-56c3950a786f (60683973-3e02-4914-a23b-56c3950a786f): created successfully Jun 16 08:50:08 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c6e549-f325-4fb6-9bee-d4b094dfe9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:08 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Flow 'volume_create_manager' (81583690-6507-4bc0-ba1a-d156e653ca8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:50:08 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-e128d431-912a-49c8-a4b9-5f3c2f01da2d tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Created volume successfully. Jun 16 08:50:08 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4.ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3" returned: 0 in 0.737s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:08 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] Lock "cinder-quobyte-ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3" released by "_delete_snapshot" :: held 3.673s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:08 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] Lock "cinder-quobyte-569d1900-5d21-4c97-8fde-8a2b6e058ee4" released by "delete_snapshot" :: held 3.696s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:08 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7" returned: 0 in 0.742s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:08 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] Created reservations ['256ac50d-7b1b-4666-810a-d5cffbdb8e3d', '691fdce3-5593-406d-854a-0bf8f9a60323', 'af23484e-4eed-42c3-a443-57d36e58ed7c', 'd163dc7e-1149-43de-8cd8-8d291d0c781a'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:50:08 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Lock "cinder-quobyte-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7" released by "delete_volume" :: held 1.724s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:09 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] Delete snapshot completed successfully. Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Created reservations ['25d7d997-46a2-4669-8483-52654b88d553', 'e090b68a-aa33-43d0-9756-3f54440e32d2', '92463eaa-c7c0-4af3-94b0-51a24038f8c2', 'd3749115-fbb5-4f5f-a7e0-65f46eb6d705'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-17c8b50c-720b-4ba0-b574-9d89eff9b7d5 tempest-VolumesExtendTest-1321754475 None] Lock "cinder-ed5e546a-aa5a-4dfa-ba85-2f29a902c5f3-delete_snapshot" released by "delete_snapshot" :: held 3.892s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:09 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:50:09 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] Acquiring lock "cinder-569d1900-5d21-4c97-8fde-8a2b6e058ee4-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] Lock "cinder-569d1900-5d21-4c97-8fde-8a2b6e058ee4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] Acquiring lock "cinder-quobyte-569d1900-5d21-4c97-8fde-8a2b6e058ee4" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] Lock "cinder-quobyte-569d1900-5d21-4c97-8fde-8a2b6e058ee4" acquired by "delete_volume" :: waited 0.045s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=108,cinder:UPDATE=130,cinder:INSERT=34,cinder:DELETE=10 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bdc2a9-5a39-48e2-9de1-63c29e0bbbbf]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Creating offline snapshot f8496510-ef9a-432a-bdfd-d08a6c819f11 of volume 60683973-3e02-4914-a23b-56c3950a786f {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[694fbc74-9861-49af-b25a-2a343e3abc43]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:09 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.732s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:50:09 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Deleted volume successfully. Jun 16 08:50:09 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 Jun 16 08:50:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-601baeb0-a74f-487e-a3ff-20c54972f960 tempest-TestServerVolumeAttachScenarioOldVersion-135152720 None] Lock "cinder-ebf9ccf1-6425-4f7b-89f3-f0bd7fe67af7-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:09 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:09 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f Jun 16 08:50:09 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:10 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4" returned: 0 in 0.825s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:10 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4 Jun 16 08:50:10 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:10 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f" returned: 0 in 0.813s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11 2G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:10 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11 2G Jun 16 08:50:10 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:11 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-569d1900-5d21-4c97-8fde-8a2b6e058ee4" returned: 0 in 0.921s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] Lock "cinder-quobyte-569d1900-5d21-4c97-8fde-8a2b6e058ee4" released by "delete_volume" :: held 1.864s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:11 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] Created reservations ['61518d90-0896-44ee-96a4-4316bca89310', 'adeec7ec-bd3f-4872-b741-4aef6613024b', 'ad3585db-88ac-4b09-8852-7b0a48104393', 'f99f60df-e890-4a6f-9f21-60d4612726b5'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:50:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:11 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:50:11 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:50:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:11 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:50:11 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:11 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11 2G" returned: 0 in 1.125s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60683973-3e02-4914-a23b-56c3950a786f -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:11 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60683973-3e02-4914-a23b-56c3950a786f -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11 Jun 16 08:50:11 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:12 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.666s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:12 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:50:12 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] Deleted volume successfully. Jun 16 08:50:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2048f904-cb25-41a4-94a3-9a2eeaef1995 tempest-VolumesExtendTest-1321754475 None] Lock "cinder-569d1900-5d21-4c97-8fde-8a2b6e058ee4-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:12 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60683973-3e02-4914-a23b-56c3950a786f -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11" returned: 0 in 0.798s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:12 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11 is being set with open permissions: ugo+rw Jun 16 08:50:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:12 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11 Jun 16 08:50:12 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:13 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11" returned: 0 in 0.657s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:13 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.info Jun 16 08:50:13 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:14 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.info" returned: 0 in 1.061s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:14 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.info is being set with open permissions: ugo+rw Jun 16 08:50:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:14 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.info Jun 16 08:50:14 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:15 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.info" returned: 0 in 0.789s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.401s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:15 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-74510c56-e84d-49fe-b9d6-473900581649 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Create snapshot completed successfully Jun 16 08:50:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Acquiring lock "cinder-f8496510-ef9a-432a-bdfd-d08a6c819f11-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "cinder-f8496510-ef9a-432a-bdfd-d08a6c819f11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Acquiring lock "cinder-quobyte-60683973-3e02-4914-a23b-56c3950a786f" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "cinder-quobyte-60683973-3e02-4914-a23b-56c3950a786f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Acquiring lock "cinder-quobyte-f8496510-ef9a-432a-bdfd-d08a6c819f11" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "cinder-quobyte-f8496510-ef9a-432a-bdfd-d08a6c819f11" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Deleting offline snapshot f8496510-ef9a-432a-bdfd-d08a6c819f11 of volume 60683973-3e02-4914-a23b-56c3950a786f {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:50:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] snapshot_file for this snap is: volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:50:16 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4beb04a-37fc-4943-a044-41eaa8a5cf86]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:50:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:16 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11 Jun 16 08:50:16 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:17 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11" returned: 0 in 0.886s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:17 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60683973-3e02-4914-a23b-56c3950a786f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:50:17 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffbe44f-e33d-4c00-8829-113169c54988]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:50:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:17 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f Jun 16 08:50:17 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:18 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f" returned: 0 in 1.359s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:18 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11 Jun 16 08:50:18 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Flow 'volume_create_manager' (db1f669e-5f71-493b-8b60-e4d4df60119e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08882de8-bf1e-4bef-b8e8-1c933cb4edd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08882de8-bf1e-4bef-b8e8-1c933cb4edd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1856528758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0148bd6-1b48-47c1-9c80-26d3145b7fef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='df0470f9a7d04383ac1bc74f5d70180c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:50:19Z,use_quota=True,user_id='297d08248d3d40c09dbe6c502c3d8500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57122023-945d-4551-bdfc-4df0b1be1a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57122023-945d-4551-bdfc-4df0b1be1a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d737954e-d157-4ca7-81ee-9bf4017b5f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d737954e-d157-4ca7-81ee-9bf4017b5f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0148bd6-1b48-47c1-9c80-26d3145b7fef', 'volume_name': 'volume-e0148bd6-1b48-47c1-9c80-26d3145b7fef', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ccef40-6e9e-4575-a6e2-495de2eb9d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ccef40-6e9e-4575-a6e2-495de2eb9d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dcac09a-f0a5-4846-ab67-cce3468e22d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:19 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Volume e0148bd6-1b48-47c1-9c80-26d3145b7fef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0148bd6-1b48-47c1-9c80-26d3145b7fef', 'volume_size': 1} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1856528758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0148bd6-1b48-47c1-9c80-26d3145b7fef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='df0470f9a7d04383ac1bc74f5d70180c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:50:19Z,use_quota=True,user_id='297d08248d3d40c09dbe6c502c3d8500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Creating volume e0148bd6-1b48-47c1-9c80-26d3145b7fef {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:50:19 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e0148bd6-1b48-47c1-9c80-26d3145b7fef 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:19 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e0148bd6-1b48-47c1-9c80-26d3145b7fef 1073741824 Jun 16 08:50:19 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:19 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11" returned: 0 in 1.214s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:19 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11 Jun 16 08:50:19 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:20 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f.f8496510-ef9a-432a-bdfd-d08a6c819f11" returned: 0 in 0.753s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:20 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e0148bd6-1b48-47c1-9c80-26d3145b7fef 1073741824" returned: 0 in 1.236s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "cinder-quobyte-f8496510-ef9a-432a-bdfd-d08a6c819f11" released by "_delete_snapshot" :: held 4.465s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "cinder-quobyte-60683973-3e02-4914-a23b-56c3950a786f" released by "delete_snapshot" :: held 4.505s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e0148bd6-1b48-47c1-9c80-26d3145b7fef {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:20 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e0148bd6-1b48-47c1-9c80-26d3145b7fef Jun 16 08:50:20 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:20 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Created reservations ['86d35461-4c9b-4c71-9bd9-50fe0e9a3b1c', 'c539e5d5-cc49-4b70-8f3b-9d5b3221f120', '9c8c2859-a9a7-4e0b-b549-2376c105741e', 'cc571a41-f813-4dc9-b75c-0d1dd242aec6'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:50:21 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Delete snapshot completed successfully. Jun 16 08:50:21 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3572adf9-3eb4-43e3-96bd-e10619e392e0 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "cinder-f8496510-ef9a-432a-bdfd-d08a6c819f11-delete_snapshot" released by "delete_snapshot" :: held 4.820s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:21 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e0148bd6-1b48-47c1-9c80-26d3145b7fef" returned: 0 in 0.714s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:50:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.101s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dcac09a-f0a5-4846-ab67-cce3468e22d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0148bd6-1b48-47c1-9c80-26d3145b7fef', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7596f70-70e7-426c-bdfe-bb1a5aa0a46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:21 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Volume volume-e0148bd6-1b48-47c1-9c80-26d3145b7fef (e0148bd6-1b48-47c1-9c80-26d3145b7fef): created successfully Jun 16 08:50:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7596f70-70e7-426c-bdfe-bb1a5aa0a46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Flow 'volume_create_manager' (db1f669e-5f71-493b-8b60-e4d4df60119e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:50:21 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-1845f6b1-6d82-416e-9cf3-4761b05b7cb2 tempest-VolumesListTestJSON-1801007602 None] Created volume successfully. Jun 16 08:50:21 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Acquiring lock "cinder-60683973-3e02-4914-a23b-56c3950a786f-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:21 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "cinder-60683973-3e02-4914-a23b-56c3950a786f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:21 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Acquiring lock "cinder-quobyte-60683973-3e02-4914-a23b-56c3950a786f" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:21 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "cinder-quobyte-60683973-3e02-4914-a23b-56c3950a786f" acquired by "delete_volume" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:21 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c342ee-0cfc-41ad-a523-e75dd198f897]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:50:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:22 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f Jun 16 08:50:22 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:22 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f" returned: 0 in 0.874s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:22 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f Jun 16 08:50:22 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Flow 'volume_create_manager' (c54b78a4-0e91-412d-83a7-93e432d5fb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d261d4-34bb-4bb3-ab8f-ae3e6d27022f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d261d4-34bb-4bb3-ab8f-ae3e6d27022f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1113964776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0373979a-ef6e-4405-bcc7-98b33262bed6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='df0470f9a7d04383ac1bc74f5d70180c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:50:23Z,use_quota=True,user_id='297d08248d3d40c09dbe6c502c3d8500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75769ce7-9300-49cd-8b75-6d9e3b68354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75769ce7-9300-49cd-8b75-6d9e3b68354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d02c7c6-e736-4c48-8bef-582a2038bd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d02c7c6-e736-4c48-8bef-582a2038bd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0373979a-ef6e-4405-bcc7-98b33262bed6', 'volume_name': 'volume-0373979a-ef6e-4405-bcc7-98b33262bed6', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2e0745-281f-4af5-8a40-41a604f4bf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2e0745-281f-4af5-8a40-41a604f4bf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ba0ef7-9b13-4475-875d-c8d063fa08e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:23 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Volume 0373979a-ef6e-4405-bcc7-98b33262bed6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0373979a-ef6e-4405-bcc7-98b33262bed6', 'volume_size': 1} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1113964776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0373979a-ef6e-4405-bcc7-98b33262bed6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='df0470f9a7d04383ac1bc74f5d70180c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:50:23Z,use_quota=True,user_id='297d08248d3d40c09dbe6c502c3d8500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Creating volume 0373979a-ef6e-4405-bcc7-98b33262bed6 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:50:23 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0373979a-ef6e-4405-bcc7-98b33262bed6 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:23 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0373979a-ef6e-4405-bcc7-98b33262bed6 1073741824 Jun 16 08:50:23 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:23 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60683973-3e02-4914-a23b-56c3950a786f" returned: 0 in 0.892s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "cinder-quobyte-60683973-3e02-4914-a23b-56c3950a786f" released by "delete_volume" :: held 1.841s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Created reservations ['c1545160-15d3-479a-a2ea-bf6b0ff97499', 'a1dd3f97-eb8e-4c29-a44b-72ee1e42c132', 'c9ba57a5-dfd9-4cd2-9d95-0cc25e2497ee', '9c5dd946-0c37-4ea0-b69f-8bf582aacef2'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:23 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:50:23 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:24 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0373979a-ef6e-4405-bcc7-98b33262bed6 1073741824" returned: 0 in 1.121s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0373979a-ef6e-4405-bcc7-98b33262bed6 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:24 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0373979a-ef6e-4405-bcc7-98b33262bed6 Jun 16 08:50:24 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:24 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.849s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:24 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:50:24 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Deleted volume successfully. Jun 16 08:50:24 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-130f6fde-3642-4332-911f-337c6adeafa5 tempest-VolumesSnapshotNegativeTestJSON-1527674746 None] Lock "cinder-60683973-3e02-4914-a23b-56c3950a786f-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:25 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0373979a-ef6e-4405-bcc7-98b33262bed6" returned: 0 in 0.755s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:50:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ba0ef7-9b13-4475-875d-c8d063fa08e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0373979a-ef6e-4405-bcc7-98b33262bed6', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28de4fab-8e35-421d-90af-35d4227cd2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:25 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Volume volume-0373979a-ef6e-4405-bcc7-98b33262bed6 (0373979a-ef6e-4405-bcc7-98b33262bed6): created successfully Jun 16 08:50:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28de4fab-8e35-421d-90af-35d4227cd2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Flow 'volume_create_manager' (c54b78a4-0e91-412d-83a7-93e432d5fb29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:50:25 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-38c74e81-e28f-4c82-be63-d3c390045691 tempest-VolumesListTestJSON-1801007602 None] Created volume successfully. Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Flow 'volume_create_manager' (8921fd02-17d3-4a0c-b7b7-f7b07edbc240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904ef73c-f40f-4986-a583-5fd2bf384251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904ef73c-f40f-4986-a583-5fd2bf384251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1421409125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650ddb71-a2c1-49f2-b783-ec1ef7cb72c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='df0470f9a7d04383ac1bc74f5d70180c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:50:27Z,use_quota=True,user_id='297d08248d3d40c09dbe6c502c3d8500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0086ff8-0411-4276-9838-37adf4bc23c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0086ff8-0411-4276-9838-37adf4bc23c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a148ac5e-6717-41a2-886c-2929f3ec01c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a148ac5e-6717-41a2-886c-2929f3ec01c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '650ddb71-a2c1-49f2-b783-ec1ef7cb72c6', 'volume_name': 'volume-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cbc8bf-7c9d-4d44-b1d6-c8c2e9c5f48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cbc8bf-7c9d-4d44-b1d6-c8c2e9c5f48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40636752-f84b-4a27-bfff-0ad47b99c245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:27 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Volume 650ddb71-a2c1-49f2-b783-ec1ef7cb72c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6', 'volume_size': 1} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1421409125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650ddb71-a2c1-49f2-b783-ec1ef7cb72c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='df0470f9a7d04383ac1bc74f5d70180c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:50:27Z,use_quota=True,user_id='297d08248d3d40c09dbe6c502c3d8500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Creating volume 650ddb71-a2c1-49f2-b783-ec1ef7cb72c6 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:50:27 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:50:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:27 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6 1073741824 Jun 16 08:50:27 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:28 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6 1073741824" returned: 0 in 1.123s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:28 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6 Jun 16 08:50:28 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:29 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6" returned: 0 in 0.712s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:29 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:50:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40636752-f84b-4a27-bfff-0ad47b99c245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecec945-d092-4095-a7c9-2fc398f477f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:29 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Volume volume-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6 (650ddb71-a2c1-49f2-b783-ec1ef7cb72c6): created successfully Jun 16 08:50:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecec945-d092-4095-a7c9-2fc398f477f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Flow 'volume_create_manager' (8921fd02-17d3-4a0c-b7b7-f7b07edbc240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:50:29 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-93c5d837-a719-41e1-93cf-3699b9588800 tempest-VolumesListTestJSON-1801007602 None] Created volume successfully. Jun 16 08:50:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:50:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:50:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:50:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:30 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:50:30 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:30 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.681s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:30 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:50:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:50:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:50:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:50:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] Acquiring lock "cinder-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] Lock "cinder-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] Acquiring lock "cinder-quobyte-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] Lock "cinder-quobyte-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6" acquired by "delete_volume" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:32 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ecfb63-195e-4666-b456-62a0556d3b8d]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:50:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:33 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6 Jun 16 08:50:33 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:33 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6" returned: 0 in 0.801s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:33 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6 Jun 16 08:50:33 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:34 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6" returned: 0 in 0.754s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:34 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] Lock "cinder-quobyte-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6" released by "delete_volume" :: held 1.627s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:34 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] Created reservations ['d657e415-ecda-4cc5-8d74-02225b018c63', '53ccc4dd-8e9d-4c79-9ebd-7fe1469d84a7', 'ceb33c7b-0d0a-46e7-9771-d59ee0099cf1', '37f265a5-8164-4e89-bf44-816ec530a21c'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:50:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:50:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:50:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:34 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:50:34 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:35 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] Acquiring lock "cinder-0373979a-ef6e-4405-bcc7-98b33262bed6-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:35 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] Lock "cinder-0373979a-ef6e-4405-bcc7-98b33262bed6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:35 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] Acquiring lock "cinder-quobyte-0373979a-ef6e-4405-bcc7-98b33262bed6" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:35 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] Lock "cinder-quobyte-0373979a-ef6e-4405-bcc7-98b33262bed6" acquired by "delete_volume" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:35 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c209c4-f1a8-49e6-a3bb-e43cc5e9e9b6]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:50:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0373979a-ef6e-4405-bcc7-98b33262bed6 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:35 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.773s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:35 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:50:35 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] Deleted volume successfully. Jun 16 08:50:35 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-27c945ce-c6bf-4797-a254-b40a8fc55efc tempest-VolumesListTestJSON-1801007602 None] Lock "cinder-650ddb71-a2c1-49f2-b783-ec1ef7cb72c6-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:35 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0373979a-ef6e-4405-bcc7-98b33262bed6 Jun 16 08:50:35 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:36 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0373979a-ef6e-4405-bcc7-98b33262bed6" returned: 0 in 0.853s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0373979a-ef6e-4405-bcc7-98b33262bed6 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:36 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0373979a-ef6e-4405-bcc7-98b33262bed6 Jun 16 08:50:36 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:37 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0373979a-ef6e-4405-bcc7-98b33262bed6" returned: 0 in 0.936s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] Lock "cinder-quobyte-0373979a-ef6e-4405-bcc7-98b33262bed6" released by "delete_volume" :: held 1.850s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:37 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] Created reservations ['a21360e2-3f7a-4e12-9ec9-f819f5c3da5f', '619b3dd9-9a18-4d35-a36d-d86b47db82b4', '0e08d980-8f33-459e-8d51-9735fa08ccc7', 'c3218463-366b-4a7f-b094-6e2fe3362c11'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:50:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:50:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:50:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:37 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:50:37 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] Acquiring lock "cinder-e0148bd6-1b48-47c1-9c80-26d3145b7fef-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] Lock "cinder-e0148bd6-1b48-47c1-9c80-26d3145b7fef-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] Acquiring lock "cinder-quobyte-e0148bd6-1b48-47c1-9c80-26d3145b7fef" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:50:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] Lock "cinder-quobyte-e0148bd6-1b48-47c1-9c80-26d3145b7fef" acquired by "delete_volume" :: waited 0.023s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:50:37 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa62399-3c92-40b7-b07d-4cd24cec945c]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:50:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e0148bd6-1b48-47c1-9c80-26d3145b7fef {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:37 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e0148bd6-1b48-47c1-9c80-26d3145b7fef Jun 16 08:50:37 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:38 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.088s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:38 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:50:38 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] Deleted volume successfully. Jun 16 08:50:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-937c2050-56cc-4726-897c-6ba7c8387886 tempest-VolumesListTestJSON-1801007602 None] Lock "cinder-0373979a-ef6e-4405-bcc7-98b33262bed6-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:38 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e0148bd6-1b48-47c1-9c80-26d3145b7fef" returned: 0 in 1.110s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e0148bd6-1b48-47c1-9c80-26d3145b7fef {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:39 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e0148bd6-1b48-47c1-9c80-26d3145b7fef Jun 16 08:50:39 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:39 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e0148bd6-1b48-47c1-9c80-26d3145b7fef" returned: 0 in 0.876s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] Lock "cinder-quobyte-e0148bd6-1b48-47c1-9c80-26d3145b7fef" released by "delete_volume" :: held 2.072s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:39 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] Created reservations ['0a458104-5085-41a0-b955-095f088520e0', 'c230cfac-5c97-4c8e-b8c0-234eed8439fb', '92e8289d-2f8f-435b-a855-81eb2c7f81c2', '4db286f2-b06e-45b0-af9a-86047e0367cd'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Flow 'volume_create_manager' (db3f84f2-51b1-46df-ab59-151e76bad339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa85a71d-68dd-41a0-b98c-1dad412103a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa85a71d-68dd-41a0-b98c-1dad412103a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1398064797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48eea62-1aa4-481e-a763-4c8d98529e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b649785e8e3844d6a0ca9397da97aaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:50:40Z,use_quota=True,user_id='d979c0848bb1467fa3407c0ffb322311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d95c4d-61bb-4ae1-aca6-b020fb25f51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d95c4d-61bb-4ae1-aca6-b020fb25f51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ce98c2-fef6-4dcd-a356-7598b0d09cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ce98c2-fef6-4dcd-a356-7598b0d09cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a48eea62-1aa4-481e-a763-4c8d98529e91', 'volume_name': 'volume-a48eea62-1aa4-481e-a763-4c8d98529e91', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799e28ce-27b6-4772-aca7-8154d104cfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799e28ce-27b6-4772-aca7-8154d104cfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc728e54-3885-4cf8-bc82-856df6d5945f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:40 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Volume a48eea62-1aa4-481e-a763-4c8d98529e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a48eea62-1aa4-481e-a763-4c8d98529e91', 'volume_size': 1} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1398064797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48eea62-1aa4-481e-a763-4c8d98529e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b649785e8e3844d6a0ca9397da97aaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:50:40Z,use_quota=True,user_id='d979c0848bb1467fa3407c0ffb322311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Creating volume a48eea62-1aa4-481e-a763-4c8d98529e91 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:50:40 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a48eea62-1aa4-481e-a763-4c8d98529e91 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:50:40 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a48eea62-1aa4-481e-a763-4c8d98529e91 1073741824 Jun 16 08:50:40 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:40 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:50:40 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:41 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.911s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:41 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:50:41 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] Deleted volume successfully. Jun 16 08:50:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cf50402f-5745-40e1-8e5e-01f65823de37 tempest-VolumesListTestJSON-1801007602 None] Lock "cinder-e0148bd6-1b48-47c1-9c80-26d3145b7fef-delete_volume" released by "delete_volume" :: held 3.442s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:50:41 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a48eea62-1aa4-481e-a763-4c8d98529e91 1073741824" returned: 0 in 1.237s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a48eea62-1aa4-481e-a763-4c8d98529e91 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:41 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a48eea62-1aa4-481e-a763-4c8d98529e91 Jun 16 08:50:41 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:42 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a48eea62-1aa4-481e-a763-4c8d98529e91" returned: 0 in 0.625s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:50:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc728e54-3885-4cf8-bc82-856df6d5945f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a48eea62-1aa4-481e-a763-4c8d98529e91', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fadb822-dfd9-4cf6-ba91-fcf88af055a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:42 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Volume volume-a48eea62-1aa4-481e-a763-4c8d98529e91 (a48eea62-1aa4-481e-a763-4c8d98529e91): created successfully Jun 16 08:50:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fadb822-dfd9-4cf6-ba91-fcf88af055a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Flow 'volume_create_manager' (db3f84f2-51b1-46df-ab59-151e76bad339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:50:42 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-fd128dd1-8f05-4483-b2ae-6b80a63d9beb tempest-AttachVolumeTestJSON-1013321509 None] Created volume successfully. Jun 16 08:50:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-0658bad2-03f5-4069-8393-38f9a572c27c req-c6e46e65-b71a-440a-ad61-bf562213aded tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-0658bad2-03f5-4069-8393-38f9a572c27c req-c6e46e65-b71a-440a-ad61-bf562213aded tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:46 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff9fd87-a845-40b7-a5dc-ac67818eae75]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:50:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-0658bad2-03f5-4069-8393-38f9a572c27c req-c6e46e65-b71a-440a-ad61-bf562213aded tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a48eea62-1aa4-481e-a763-4c8d98529e91 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:46 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a48eea62-1aa4-481e-a763-4c8d98529e91 Jun 16 08:50:46 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:47 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-0658bad2-03f5-4069-8393-38f9a572c27c req-c6e46e65-b71a-440a-ad61-bf562213aded tempest-AttachVolumeTestJSON-1013321509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a48eea62-1aa4-481e-a763-4c8d98529e91" returned: 0 in 0.815s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-0658bad2-03f5-4069-8393-38f9a572c27c req-c6e46e65-b71a-440a-ad61-bf562213aded tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.835s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-0658bad2-03f5-4069-8393-38f9a572c27c req-c6e46e65-b71a-440a-ad61-bf562213aded tempest-AttachVolumeTestJSON-1013321509 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-a48eea62-1aa4-481e-a763-4c8d98529e91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e9fea26-2ea7-429f-938b-ed3ed6de4823', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:50:47 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-0658bad2-03f5-4069-8393-38f9a572c27c req-c6e46e65-b71a-440a-ad61-bf562213aded tempest-AttachVolumeTestJSON-1013321509 None] attachment_update completed successfully. Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Flow 'volume_create_manager' (b8898f8c-1f42-4160-b784-f1c42187019a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f139e417-8044-471c-9723-c2be90984eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f139e417-8044-471c-9723-c2be90984eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1650361266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e058f7f6-3f86-4b34-a54d-208bdbe8399f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564c9eea84e746eda5a59e73bf46c5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:50:49Z,use_quota=True,user_id='98ec2e399ef74f0f90b7b5131bf93a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6676e796-32df-4739-8700-ab68b1b415ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6676e796-32df-4739-8700-ab68b1b415ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14935b7b-ee95-4a85-a144-7e09694f9737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14935b7b-ee95-4a85-a144-7e09694f9737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e058f7f6-3f86-4b34-a54d-208bdbe8399f', 'volume_name': 'volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce8d121-2a0e-4c37-945f-f168356489b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce8d121-2a0e-4c37-945f-f168356489b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066e1468-0bbf-4646-b5b6-852a12584a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:49 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Volume e058f7f6-3f86-4b34-a54d-208bdbe8399f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f', 'volume_size': 1} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1650361266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e058f7f6-3f86-4b34-a54d-208bdbe8399f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564c9eea84e746eda5a59e73bf46c5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:50:49Z,use_quota=True,user_id='98ec2e399ef74f0f90b7b5131bf93a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Creating volume e058f7f6-3f86-4b34-a54d-208bdbe8399f {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:50:49 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:49 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f 1073741824 Jun 16 08:50:49 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Flow 'volume_create_manager' (44c8318c-995b-4cd5-8027-4e59569ad712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b796f6-a7cb-4cbf-a726-bc716aef33fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b796f6-a7cb-4cbf-a726-bc716aef33fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1608971032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab78fbdc-ee7f-43b5-a722-1870d1b227f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564c9eea84e746eda5a59e73bf46c5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:50:50Z,use_quota=True,user_id='98ec2e399ef74f0f90b7b5131bf93a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78ad737-238e-41b9-9820-51d55896acb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78ad737-238e-41b9-9820-51d55896acb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2a208b-7c77-4620-9eca-5327d1c44537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2a208b-7c77-4620-9eca-5327d1c44537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab78fbdc-ee7f-43b5-a722-1870d1b227f9', 'volume_name': 'volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027462ca-56d7-4e4e-9f02-727022a9987b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027462ca-56d7-4e4e-9f02-727022a9987b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9f66c4-b9fe-4346-82ba-0a7765cac33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:49 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Volume ab78fbdc-ee7f-43b5-a722-1870d1b227f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9', 'volume_size': 1} Jun 16 08:50:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:50 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f 1073741824" returned: 0 in 1.266s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:50 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f Jun 16 08:50:50 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:51 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f" returned: 0 in 0.747s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:50:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.487s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1608971032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab78fbdc-ee7f-43b5-a722-1870d1b227f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564c9eea84e746eda5a59e73bf46c5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:50:50Z,use_quota=True,user_id='98ec2e399ef74f0f90b7b5131bf93a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:50:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Creating volume ab78fbdc-ee7f-43b5-a722-1870d1b227f9 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:50:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:50:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:50:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:50:51 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:50:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066e1468-0bbf-4646-b5b6-852a12584a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (785e134c-c594-4ce2-8aac-2d40089a9c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:51 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9 1073741824 Jun 16 08:50:51 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:51 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Volume volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f (e058f7f6-3f86-4b34-a54d-208bdbe8399f): created successfully Jun 16 08:50:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (785e134c-c594-4ce2-8aac-2d40089a9c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Flow 'volume_create_manager' (b8898f8c-1f42-4160-b784-f1c42187019a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:50:51 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-cc7fb80b-1b6f-42cf-b6ec-dd1ea59126bc tempest-TestServerVolumeAttachmentScenario-847416422 None] Created volume successfully. Jun 16 08:50:52 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:50:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Flow 'volume_create_manager' (d2973129-6d8b-496d-aaf2-f39968e2b8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:50:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0da8ed-0628-4ac0-ae4e-e0921eb26424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0da8ed-0628-4ac0-ae4e-e0921eb26424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-146032221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825d4172-2ca5-4725-ab61-ad9fa8e1f394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b649785e8e3844d6a0ca9397da97aaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:50:52Z,use_quota=True,user_id='d979c0848bb1467fa3407c0ffb322311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3f3cc8-c89e-4faf-9651-d78d70ad5acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3f3cc8-c89e-4faf-9651-d78d70ad5acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a68a4a-0e15-4ae8-8524-0b723b97b130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a68a4a-0e15-4ae8-8524-0b723b97b130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '825d4172-2ca5-4725-ab61-ad9fa8e1f394', 'volume_name': 'volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab05f6cf-fe9d-40a9-914e-f059b27f7c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab05f6cf-fe9d-40a9-914e-f059b27f7c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0a519e-a360-4c40-9403-1fd0e08a69af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:52 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Volume 825d4172-2ca5-4725-ab61-ad9fa8e1f394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394', 'volume_size': 1} Jun 16 08:50:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:52 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9 1073741824" returned: 0 in 1.044s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:52 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9 Jun 16 08:50:52 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:53 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9" returned: 0 in 0.698s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:50:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.803s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-146032221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825d4172-2ca5-4725-ab61-ad9fa8e1f394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b649785e8e3844d6a0ca9397da97aaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:50:52Z,use_quota=True,user_id='d979c0848bb1467fa3407c0ffb322311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:50:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Creating volume 825d4172-2ca5-4725-ab61-ad9fa8e1f394 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:50:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:50:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:50:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:50:53 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:50:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9f66c4-b9fe-4346-82ba-0a7765cac33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09915ea-1dd7-4363-b54a-c01928e9cf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:53 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394 1073741824 Jun 16 08:50:53 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:53 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Volume volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9 (ab78fbdc-ee7f-43b5-a722-1870d1b227f9): created successfully Jun 16 08:50:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09915ea-1dd7-4363-b54a-c01928e9cf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Flow 'volume_create_manager' (44c8318c-995b-4cd5-8027-4e59569ad712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:50:53 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-6d39bcaf-3519-4fcc-9787-be651756096a tempest-TestServerVolumeAttachmentScenario-847416422 None] Created volume successfully. Jun 16 08:50:54 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394 1073741824" returned: 0 in 0.940s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:54 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394 Jun 16 08:50:54 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:50:54 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Jun 16 08:50:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394" returned: 0 in 0.667s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:50:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:50:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:50:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0a519e-a360-4c40-9403-1fd0e08a69af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77120cc0-af54-46dc-8c7c-5fb18c1e57c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:50:55 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Volume volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394 (825d4172-2ca5-4725-ab61-ad9fa8e1f394): created successfully Jun 16 08:50:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77120cc0-af54-46dc-8c7c-5fb18c1e57c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:50:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Flow 'volume_create_manager' (d2973129-6d8b-496d-aaf2-f39968e2b8f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:50:55 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-97fcb499-17e7-4b52-a93d-37dd28f846d8 tempest-AttachVolumeTestJSON-1013321509 None] Created volume successfully. Jun 16 08:50:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-84c5723a-a7f2-4225-b32d-a52e81f2b9d6 req-f95e0c6f-ebc0-4092-9a7a-a702a9c3b038 tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:50:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-84c5723a-a7f2-4225-b32d-a52e81f2b9d6 req-f95e0c6f-ebc0-4092-9a7a-a702a9c3b038 tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:50:59 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e2e62e-079a-4ad6-8de7-b70870445ecc]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:50:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-84c5723a-a7f2-4225-b32d-a52e81f2b9d6 req-f95e0c6f-ebc0-4092-9a7a-a702a9c3b038 tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:50:59 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394 Jun 16 08:50:59 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:00 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-84c5723a-a7f2-4225-b32d-a52e81f2b9d6 req-f95e0c6f-ebc0-4092-9a7a-a702a9c3b038 tempest-AttachVolumeTestJSON-1013321509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394" returned: 0 in 0.859s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-84c5723a-a7f2-4225-b32d-a52e81f2b9d6 req-f95e0c6f-ebc0-4092-9a7a-a702a9c3b038 tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.879s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:51:00 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-84c5723a-a7f2-4225-b32d-a52e81f2b9d6 req-f95e0c6f-ebc0-4092-9a7a-a702a9c3b038 tempest-AttachVolumeTestJSON-1013321509 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e7ce2c2-ff33-4c18-b213-9a5d40c91a5d', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:51:00 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-84c5723a-a7f2-4225-b32d-a52e81f2b9d6 req-f95e0c6f-ebc0-4092-9a7a-a702a9c3b038 tempest-AttachVolumeTestJSON-1013321509 None] attachment_update completed successfully. Jun 16 08:51:06 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=75,cinder:UPDATE=91,cinder:INSERT=17,cinder:DELETE=6 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:51:06 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-5cd951e9-b2e3-4285-a154-9fc983436b07 req-46089e7a-f163-4ea0-b986-27d6ad67f757 tempest-AttachVolumeTestJSON-1013321509 None] Terminate volume connection completed successfully. Jun 16 08:51:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-5cd951e9-b2e3-4285-a154-9fc983436b07 req-46089e7a-f163-4ea0-b986-27d6ad67f757 tempest-AttachVolumeTestJSON-1013321509 None] Deleting attachment 3e9fea26-2ea7-429f-938b-ed3ed6de4823. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:51:09 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-402c6988-d1fb-471a-b927-8c4664771c0e req-e624a487-62fa-4284-8eab-bbe87d0e8a0a tempest-AttachVolumeTestJSON-1013321509 None] Terminate volume connection completed successfully. Jun 16 08:51:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-402c6988-d1fb-471a-b927-8c4664771c0e req-e624a487-62fa-4284-8eab-bbe87d0e8a0a tempest-AttachVolumeTestJSON-1013321509 None] Deleting attachment 1e7ce2c2-ff33-4c18-b213-9a5d40c91a5d. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=58,cinder:INSERT=17,cinder:UPDATE=70,cinder:DELETE=8 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Flow 'volume_create_manager' (55af719a-82bb-4584-9de2-10d83b0cde3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c6177d-d385-4117-8205-687f882eb37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c6177d-d385-4117-8205-687f882eb37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-437176138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c296b1bd3ef4f449d27d37c6388982e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:51:17Z,use_quota=True,user_id='6432d958f4124909ba2de396ec0853c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7532a20-8df9-41ee-8c87-c40c86d61228),volume_type_id=f7532a20-8df9-41ee-8c87-c40c86d61228)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61825def-ef86-40cd-b30f-4133bdcb0a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61825def-ef86-40cd-b30f-4133bdcb0a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81101fa0-d8d8-4c71-bc02-137f76dfa7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81101fa0-d8d8-4c71-bc02-137f76dfa7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc', 'volume_name': 'volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a78e08-d44c-4383-9711-e0794a058690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a78e08-d44c-4383-9711-e0794a058690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e331915-54d1-4132-aa56-281dfa4e17b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:16 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Volume 53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc', 'volume_size': 1} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-437176138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c296b1bd3ef4f449d27d37c6388982e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:51:17Z,use_quota=True,user_id='6432d958f4124909ba2de396ec0853c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7532a20-8df9-41ee-8c87-c40c86d61228),volume_type_id=f7532a20-8df9-41ee-8c87-c40c86d61228)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Creating volume 53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:51:16 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:51:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:17 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc 1073741824 Jun 16 08:51:17 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:17 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:51:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Flow 'volume_create_manager' (0a255535-9741-453b-b2a5-d0ce19856056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:51:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (447a18af-d3a5-4af6-982b-ce32dd40d7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (447a18af-d3a5-4af6-982b-ce32dd40d7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1442336349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de8ef1e-2f00-46e3-8eaf-779830e370dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c296b1bd3ef4f449d27d37c6388982e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:51:17Z,use_quota=True,user_id='6432d958f4124909ba2de396ec0853c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa477068-6dd5-4670-865f-49803cbeed41),volume_type_id=aa477068-6dd5-4670-865f-49803cbeed41)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae21ea5-f83c-4728-9a41-607d5e32bd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae21ea5-f83c-4728-9a41-607d5e32bd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7d55c5-f53c-4e1d-b73c-5f04db103d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7d55c5-f53c-4e1d-b73c-5f04db103d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7de8ef1e-2f00-46e3-8eaf-779830e370dd', 'volume_name': 'volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc82f6c-e898-4cc5-91c2-b3dad808d0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc82f6c-e898-4cc5-91c2-b3dad808d0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8997cd0-69a6-4bde-92df-ece307138bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:17 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Volume 7de8ef1e-2f00-46e3-8eaf-779830e370dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd', 'volume_size': 1} Jun 16 08:51:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:51:18 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc 1073741824" returned: 0 in 1.535s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:18 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:51:18 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Flow 'volume_create_manager' (3aab13c7-d269-4ef9-9cf5-62d6c02a815f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:51:18 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74cb93b9-0997-4162-a587-274d6501b238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:18 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74cb93b9-0997-4162-a587-274d6501b238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1118103887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24dc7a33-ec09-4693-8b18-fcec3dc740d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c296b1bd3ef4f449d27d37c6388982e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:51:19Z,use_quota=True,user_id='6432d958f4124909ba2de396ec0853c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c4ad469-4a56-4400-800d-c89beb58a294),volume_type_id=6c4ad469-4a56-4400-800d-c89beb58a294)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:18 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc Jun 16 08:51:18 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:18 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b020163-d1b3-4e55-80cf-ba83fd02860b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:18 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b020163-d1b3-4e55-80cf-ba83fd02860b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:18 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaabc6e8-1ef5-4890-bee9-bc2a9ae49e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:18 devstack cinder-volume[92348]: DEBUG cinder.image.glance [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Creating Keystone auth plugin from conf {{(pid=92348) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaabc6e8-1ef5-4890-bee9-bc2a9ae49e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '24dc7a33-ec09-4693-8b18-fcec3dc740d0', 'volume_name': 'volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0', 'volume_size': 1, 'image_id': '6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2072565213', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c296b1bd3ef4f449d27d37c6388982e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6', 'created_at': datetime.datetime(2026, 6, 16, 6, 51, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6/file', 'properties': {}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7114ca2-81fd-454f-b1dd-b2b0f05a72b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7114ca2-81fd-454f-b1dd-b2b0f05a72b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd30976-2c6d-43b9-9372-a50bd1482f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:19 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Volume 24dc7a33-ec09-4693-8b18-fcec3dc740d0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0', 'volume_size': 1, 'image_id': '6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2072565213', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c296b1bd3ef4f449d27d37c6388982e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6', 'created_at': datetime.datetime(2026, 6, 16, 6, 51, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6/file', 'properties': {}}, 'image_service': } Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Trying to clone 24dc7a33-ec09-4693-8b18-fcec3dc740d0 from image 6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6', 'metadata': {}}]). {{(pid=92348) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Flow 'volume_create_manager' (d31a1207-2515-4be8-8e83-0962a39fcced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25be7612-1d5d-4026-bda3-5da207552387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25be7612-1d5d-4026-bda3-5da207552387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2097388001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f78f2b-ca3e-4b32-bcb1-4a53f9964cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55487ba32ab241cc85fab26721ae8df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:51:19Z,use_quota=True,user_id='ffdcf76e1bed4b0ba075990f7e634b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee104ea-a0bc-428d-a9e3-8205d3f5c21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee104ea-a0bc-428d-a9e3-8205d3f5c21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322c5d27-7ea6-4d01-a2d1-fcc3abf366ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.image.glance [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Creating Keystone auth plugin from conf {{(pid=92348) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 16 08:51:19 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc" returned: 0 in 0.774s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] <== create_volume: return (2425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.428s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.653s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1442336349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de8ef1e-2f00-46e3-8eaf-779830e370dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c296b1bd3ef4f449d27d37c6388982e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:51:17Z,use_quota=True,user_id='6432d958f4124909ba2de396ec0853c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa477068-6dd5-4670-865f-49803cbeed41),volume_type_id=aa477068-6dd5-4670-865f-49803cbeed41)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Creating volume 7de8ef1e-2f00-46e3-8eaf-779830e370dd {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:51:19 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:19 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd 1073741824 Jun 16 08:51:19 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e331915-54d1-4132-aa56-281dfa4e17b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ba9be4-d043-45fb-8ceb-aa0b45439f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322c5d27-7ea6-4d01-a2d1-fcc3abf366ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '33f78f2b-ca3e-4b32-bcb1-4a53f9964cff', 'volume_name': 'volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff', 'volume_size': 1, 'image_id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '038e50e6f4094f25b7da1abcd3989b23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'created_at': datetime.datetime(2026, 6, 16, 6, 33, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 34, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdddb99a-050a-42b1-bad8-3dff46a05bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdddb99a-050a-42b1-bad8-3dff46a05bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1683bdb-cbc2-4f57-999f-00637e32e107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:19 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Volume 33f78f2b-ca3e-4b32-bcb1-4a53f9964cff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff', 'volume_size': 1, 'image_id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '038e50e6f4094f25b7da1abcd3989b23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'created_at': datetime.datetime(2026, 6, 16, 6, 33, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 34, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Trying to clone 33f78f2b-ca3e-4b32-bcb1-4a53f9964cff from image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}]). {{(pid=92348) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 16 08:51:19 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Volume volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc (53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc): created successfully Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ba9be4-d043-45fb-8ceb-aa0b45439f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Flow 'volume_create_manager' (55af719a-82bb-4584-9de2-10d83b0cde3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:51:19 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-61b56651-7be4-48ba-9b23-c1c20b512a84 tempest-TestInstancesWithCinderVolumes-778168295 None] Created volume successfully. Jun 16 08:51:20 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_dynkmu9qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 16 08:51:20 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Image download 20.69 MB at 20.69 MB/s Jun 16 08:51:20 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce6e149-c4ef-40ce-b71c-18161770850f]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:51:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_dynkmu9qdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:20 devstack sudo[103089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_dynkmu9qdevstack@QuobyteHD Jun 16 08:51:20 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:20 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd 1073741824" returned: 0 in 1.037s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:20 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd Jun 16 08:51:20 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:21 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_dynkmu9qdevstack@QuobyteHD" returned: 0 in 0.859s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Temporary image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec is fetched for user ffdcf76e1bed4b0ba075990f7e634b21. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51790d7-325c-4d9f-bf15-d658252112f9]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_dynkmu9qdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:21 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_dynkmu9qdevstack@QuobyteHD Jun 16 08:51:21 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:21 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd" returned: 0 in 0.809s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8997cd0-69a6-4bde-92df-ece307138bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f6ad59-9893-4d27-b9ee-7d80b5f0d549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:21 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Volume volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd (7de8ef1e-2f00-46e3-8eaf-779830e370dd): created successfully Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f6ad59-9893-4d27-b9ee-7d80b5f0d549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Flow 'volume_create_manager' (0a255535-9741-453b-b2a5-d0ce19856056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:51:21 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-d2ba36ff-45ed-467c-864e-ad98f2eb9bf4 tempest-TestInstancesWithCinderVolumes-778168295 None] Created volume successfully. Jun 16 08:51:21 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_dynkmu9qdevstack@QuobyteHD" returned: 0 in 0.714s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2097388001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f78f2b-ca3e-4b32-bcb1-4a53f9964cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55487ba32ab241cc85fab26721ae8df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:51:19Z,use_quota=True,user_id='ffdcf76e1bed4b0ba075990f7e634b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Creating volume 33f78f2b-ca3e-4b32-bcb1-4a53f9964cff {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:51:21 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:51:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:21 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff 1073741824 Jun 16 08:51:21 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "cinder-825d4172-2ca5-4725-ab61-ad9fa8e1f394-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:51:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] Lock "cinder-825d4172-2ca5-4725-ab61-ad9fa8e1f394-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:51:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "cinder-quobyte-825d4172-2ca5-4725-ab61-ad9fa8e1f394" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:51:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] Lock "cinder-quobyte-825d4172-2ca5-4725-ab61-ad9fa8e1f394" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:51:22 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2873a852-5c9a-4e76-be1b-db891917622e]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:51:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:22 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394 Jun 16 08:51:22 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:22 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff 1073741824" returned: 0 in 1.150s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:23 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff Jun 16 08:51:23 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:24 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394" returned: 0 in 1.606s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:24 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394 Jun 16 08:51:24 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:24 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff" returned: 0 in 1.246s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:24 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] <== create_volume: return (2473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:51:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.477s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:51:24 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Attempting download of 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec ((None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}])) to volume 33f78f2b-ca3e-4b32-bcb1-4a53f9964cff. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 16 08:51:24 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfbd6ca-2702-4953-80ef-98a575ecd530]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:51:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_z3gnazeh {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:24 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_yemzku64devstack@QuobyteHD, size 20.69 MB, duration 5.47 sec {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 16 08:51:24 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Image download 20.69 MB at 3.79 MB/s Jun 16 08:51:24 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_z3gnazeh Jun 16 08:51:24 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:24 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc9a92f-e12b-4964-b3c6-e56af632733a]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:51:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_yemzku64devstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:24 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_yemzku64devstack@QuobyteHD Jun 16 08:51:24 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:24 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-825d4172-2ca5-4725-ab61-ad9fa8e1f394" returned: 0 in 0.729s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:24 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] Lock "cinder-quobyte-825d4172-2ca5-4725-ab61-ad9fa8e1f394" released by "delete_volume" :: held 2.396s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:51:25 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] Created reservations ['22584569-b0e3-4cc5-a7a0-a26fd80d5f51', '1e3f9c31-5502-4b0b-8591-6331c2c09688', '841b8a6c-33c5-470a-8145-4f81b8640c2b', 'c5d8d508-a16c-42a0-9805-8f80853c3367'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:51:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:51:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:51:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:51:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:51:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:51:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:25 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:51:25 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:25 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_z3gnazeh" returned: 0 in 1.036s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_z3gnazeh {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:25 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_z3gnazeh Jun 16 08:51:25 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:25 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_yemzku64devstack@QuobyteHD" returned: 0 in 1.378s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:25 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Temporary image 6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6 is fetched for user 6432d958f4124909ba2de396ec0853c9. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 16 08:51:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "cinder-a48eea62-1aa4-481e-a763-4c8d98529e91-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:51:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] Lock "cinder-a48eea62-1aa4-481e-a763-4c8d98529e91-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:51:26 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c898137-ad63-484a-b64e-023a2b94f1f8]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:51:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_yemzku64devstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "cinder-quobyte-a48eea62-1aa4-481e-a763-4c8d98529e91" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:51:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] Lock "cinder-quobyte-a48eea62-1aa4-481e-a763-4c8d98529e91" acquired by "delete_volume" :: waited 0.027s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:51:26 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e093f3fd-123c-46d2-8769-1c333403e189]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:51:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a48eea62-1aa4-481e-a763-4c8d98529e91 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:26 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_yemzku64devstack@QuobyteHD Jun 16 08:51:26 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:26 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a48eea62-1aa4-481e-a763-4c8d98529e91 Jun 16 08:51:26 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:26 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.256s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:26 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:51:26 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] Deleted volume successfully. Jun 16 08:51:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4050f2c1-3f1c-46c8-bc66-8c2c07c744fd tempest-AttachVolumeTestJSON-1013321509 None] Lock "cinder-825d4172-2ca5-4725-ab61-ad9fa8e1f394-delete_volume" released by "delete_volume" :: held 3.971s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:51:26 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_z3gnazeh" returned: 1 in 1.343s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_z3gnazeh' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:51:26 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a388dc06-ca29-43b0-84c7-1f757684489e]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:51:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_dynkmu9qdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:26 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_dynkmu9qdevstack@QuobyteHD Jun 16 08:51:26 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:27 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:27 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a48eea62-1aa4-481e-a763-4c8d98529e91" returned: 0 in 1.048s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a48eea62-1aa4-481e-a763-4c8d98529e91 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_yemzku64devstack@QuobyteHD" returned: 0 in 1.173s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:51:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:51:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1118103887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24dc7a33-ec09-4693-8b18-fcec3dc740d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c296b1bd3ef4f449d27d37c6388982e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:51:19Z,use_quota=True,user_id='6432d958f4124909ba2de396ec0853c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c4ad469-4a56-4400-800d-c89beb58a294),volume_type_id=6c4ad469-4a56-4400-800d-c89beb58a294)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:51:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Creating volume 24dc7a33-ec09-4693-8b18-fcec3dc740d0 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:51:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:51:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:51:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:51:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:51:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:51:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:51:27 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a48eea62-1aa4-481e-a763-4c8d98529e91 Jun 16 08:51:27 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:51:27 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:27 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 1073741824 Jun 16 08:51:27 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:27 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_dynkmu9qdevstack@QuobyteHD" returned: 0 in 1.040s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:27 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec was qcow2, converting to raw {{(pid=92348) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 16 08:51:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_dynkmu9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:27 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_dynkmu9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff Jun 16 08:51:27 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:28 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a48eea62-1aa4-481e-a763-4c8d98529e91" returned: 0 in 0.780s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:28 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] Lock "cinder-quobyte-a48eea62-1aa4-481e-a763-4c8d98529e91" released by "delete_volume" :: held 1.917s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:51:28 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] Created reservations ['8a93889d-58dd-4bce-bfaf-b5e58a8d0a3b', '88b4d356-c085-47b0-9db4-b9d3b0f4bfbd', '3e797717-a819-4d00-a4d8-d4784865ccdc', 'b86aa5a5-3080-44d2-a652-776645b7ed8b'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:51:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:51:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:51:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:51:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:51:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:51:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:28 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:51:28 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:28 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 1073741824" returned: 0 in 1.470s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:28 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 Jun 16 08:51:28 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:29 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.868s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:29 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:51:29 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] Deleted volume successfully. Jun 16 08:51:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-29cd99f5-6fc0-4064-b022-36e970784fb3 tempest-AttachVolumeTestJSON-1013321509 None] Lock "cinder-a48eea62-1aa4-481e-a763-4c8d98529e91-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:51:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "cinder-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:51:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] Lock "cinder-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:51:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "cinder-quobyte-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:51:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] Lock "cinder-quobyte-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1" acquired by "delete_volume" :: waited 0.034s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:51:29 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0" returned: 0 in 0.944s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:29 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] <== create_volume: return (2487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:51:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.492s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:51:29 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1ac44e-43c2-4237-8520-603407f9bef0]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:51:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:29 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Attempting download of 6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6 ((None, [{'url': 'file:///opt/stack/data/glance/images/6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6', 'metadata': {}}])) to volume 24dc7a33-ec09-4693-8b18-fcec3dc740d0. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 16 08:51:29 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[55421551-7cf7-4659-a0e4-266c21f63610]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:51:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_4i13afzm {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:30 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1 Jun 16 08:51:30 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:30 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_4i13afzm Jun 16 08:51:30 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:51:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:51:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:51:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:51:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:51:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:51:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:30 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:51:30 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:30 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_dynkmu9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff" returned: 0 in 2.892s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:30 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_33c9a27b-cb4d-49f9-acbe-f121ce5d46ec_dynkmu9qdevstack@QuobyteHD, size 112.00 MB, duration 2.89 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:51:30 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Converted 112.00 MB image at 38.71 MB/s Jun 16 08:51:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:30 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff 1G Jun 16 08:51:30 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:31 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_4i13afzm" returned: 0 in 1.242s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_4i13afzm {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:31 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1" returned: 0 in 1.408s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:31 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1 Jun 16 08:51:31 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:31 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.140s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:31 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:51:31 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:51:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:51:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:51:31 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_4i13afzm Jun 16 08:51:31 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:31 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff 1G" returned: 0 in 0.883s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:31 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ce488b-e492-4e91-baf2-b42dfd54df26]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:51:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:31 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff Jun 16 08:51:31 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:32 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1" returned: 0 in 0.798s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] Lock "cinder-quobyte-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1" released by "delete_volume" :: held 2.282s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:51:32 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_4i13afzm" returned: 1 in 0.881s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_4i13afzm' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be5d563-0028-4e8a-a2eb-1ba6c9580141]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_yemzku64devstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] Created reservations ['892c4854-8f8f-42c7-bcd6-e6acfee89431', '4a66bb94-b409-44fd-8d3c-8c96e5a3925c', 'd06b0c96-5a55-44bf-8dea-a025d29efdc2', '8fc84f3d-ce3a-4f97-a7ab-ae085e7d05e5'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:51:32 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_yemzku64devstack@QuobyteHD Jun 16 08:51:32 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:32 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:51:32 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:32 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff" returned: 0 in 0.838s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:32 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff Jun 16 08:51:32 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:32 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_yemzku64devstack@QuobyteHD" returned: 0 in 0.830s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] 6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6 was qcow2, converting to raw {{(pid=92348) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 16 08:51:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_yemzku64devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:32 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_yemzku64devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 Jun 16 08:51:32 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:33 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.832s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:33 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:51:33 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] Deleted volume successfully. Jun 16 08:51:33 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-aa039d4e-38f8-40a4-acca-f8c24c36c249 tempest-AttachVolumeTestJSON-1013321509 None] Lock "cinder-ef1328c6-cbb1-4bd1-b443-1c8e4edd0fb1-delete_volume" released by "delete_volume" :: held 3.505s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:51:33 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff" returned: 1 in 0.860s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:51:33 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Downloaded image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec ((None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}])) to volume 33f78f2b-ca3e-4b32-bcb1-4a53f9964cff successfully. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 16 08:51:33 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Temporary image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec for user ffdcf76e1bed4b0ba075990f7e634b21 is deleted. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 16 08:51:33 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Marking volume 33f78f2b-ca3e-4b32-bcb1-4a53f9964cff as bootable. {{(pid=92348) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 16 08:51:33 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Copying metadata from image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec to 33f78f2b-ca3e-4b32-bcb1-4a53f9964cff. {{(pid=92348) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 16 08:51:33 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Creating volume glance metadata for volume 33f78f2b-ca3e-4b32-bcb1-4a53f9964cff backed by image 33c9a27b-cb4d-49f9-acbe-f121ce5d46ec with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92348) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 16 08:51:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1683bdb-cbc2-4f57-999f-00637e32e107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff', 'volume_size': 1, 'image_id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '038e50e6f4094f25b7da1abcd3989b23', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '33c9a27b-cb4d-49f9-acbe-f121ce5d46ec', 'created_at': datetime.datetime(2026, 6, 16, 6, 33, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 34, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33c9a27b-cb4d-49f9-acbe-f121ce5d46ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b391c1f-5311-48c7-9d04-b251ad494d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:33 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Volume volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff (33f78f2b-ca3e-4b32-bcb1-4a53f9964cff): created successfully Jun 16 08:51:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b391c1f-5311-48c7-9d04-b251ad494d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Flow 'volume_create_manager' (d31a1207-2515-4be8-8e83-0962a39fcced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:51:33 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-67790e16-c276-4ba9-bd5f-736cdf47d133 tempest-TestShelveInstance-1708714429 None] Created volume successfully. Jun 16 08:51:35 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_yemzku64devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0" returned: 0 in 2.267s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:35 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6_yemzku64devstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:51:35 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Converted 112.00 MB image at 49.36 MB/s Jun 16 08:51:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:35 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 1G Jun 16 08:51:35 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:36 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 1G" returned: 0 in 0.993s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:36 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[70008369-df43-49d0-9833-5be667c0f557]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:51:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:36 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 Jun 16 08:51:36 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:37 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0" returned: 0 in 0.945s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:37 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 Jun 16 08:51:37 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:37 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0" returned: 1 in 0.774s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:51:37 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Downloaded image 6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6 ((None, [{'url': 'file:///opt/stack/data/glance/images/6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6', 'metadata': {}}])) to volume 24dc7a33-ec09-4693-8b18-fcec3dc740d0 successfully. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 16 08:51:37 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Temporary image 6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6 for user 6432d958f4124909ba2de396ec0853c9 is deleted. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 16 08:51:37 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Marking volume 24dc7a33-ec09-4693-8b18-fcec3dc740d0 as bootable. {{(pid=92348) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 16 08:51:37 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Copying metadata from image 6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6 to 24dc7a33-ec09-4693-8b18-fcec3dc740d0. {{(pid=92348) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 16 08:51:37 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Creating volume glance metadata for volume 24dc7a33-ec09-4693-8b18-fcec3dc740d0 backed by image 6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6 with: {'image_id': '6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6', 'image_name': 'tempest-scenario-img--2072565213', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92348) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 16 08:51:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd30976-2c6d-43b9-9372-a50bd1482f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0', 'volume_size': 1, 'image_id': '6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2072565213', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c296b1bd3ef4f449d27d37c6388982e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6', 'created_at': datetime.datetime(2026, 6, 16, 6, 51, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 51, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c6dfcf9-bc47-4c6d-8a03-2c3770a089b6/file', 'properties': {}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7423ce5e-a5d2-4200-9f06-2e8552b407d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:51:38 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Volume volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 (24dc7a33-ec09-4693-8b18-fcec3dc740d0): created successfully Jun 16 08:51:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7423ce5e-a5d2-4200-9f06-2e8552b407d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:51:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Flow 'volume_create_manager' (3aab13c7-d269-4ef9-9cf5-62d6c02a815f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:51:38 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-93523ed8-32df-479b-819a-f257f6dd87a0 tempest-TestInstancesWithCinderVolumes-778168295 None] Created volume successfully. Jun 16 08:51:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-cc03b5b0-ff3b-4ef8-a397-392df5a84e1e req-1c0b01cd-c3b3-4bed-9c23-9112d5bb27e7 tempest-TestShelveInstance-1708714429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:51:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-cc03b5b0-ff3b-4ef8-a397-392df5a84e1e req-1c0b01cd-c3b3-4bed-9c23-9112d5bb27e7 tempest-TestShelveInstance-1708714429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:51:42 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf7cb73-14bf-4a54-867f-5f51b70d8aff]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:51:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-cc03b5b0-ff3b-4ef8-a397-392df5a84e1e req-1c0b01cd-c3b3-4bed-9c23-9112d5bb27e7 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:42 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff Jun 16 08:51:42 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:43 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-cc03b5b0-ff3b-4ef8-a397-392df5a84e1e req-1c0b01cd-c3b3-4bed-9c23-9112d5bb27e7 tempest-TestShelveInstance-1708714429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff" returned: 0 in 0.860s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-cc03b5b0-ff3b-4ef8-a397-392df5a84e1e req-1c0b01cd-c3b3-4bed-9c23-9112d5bb27e7 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:43 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff Jun 16 08:51:43 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:44 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-cc03b5b0-ff3b-4ef8-a397-392df5a84e1e req-1c0b01cd-c3b3-4bed-9c23-9112d5bb27e7 tempest-TestShelveInstance-1708714429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff" returned: 1 in 1.017s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-cc03b5b0-ff3b-4ef8-a397-392df5a84e1e req-1c0b01cd-c3b3-4bed-9c23-9112d5bb27e7 tempest-TestShelveInstance-1708714429 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:51:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-cc03b5b0-ff3b-4ef8-a397-392df5a84e1e req-1c0b01cd-c3b3-4bed-9c23-9112d5bb27e7 tempest-TestShelveInstance-1708714429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.939s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:51:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-cc03b5b0-ff3b-4ef8-a397-392df5a84e1e req-1c0b01cd-c3b3-4bed-9c23-9112d5bb27e7 tempest-TestShelveInstance-1708714429 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc112971-8906-4a2e-8e99-5a66fdb99318', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:51:44 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-cc03b5b0-ff3b-4ef8-a397-392df5a84e1e req-1c0b01cd-c3b3-4bed-9c23-9112d5bb27e7 tempest-TestShelveInstance-1708714429 None] attachment_update completed successfully. Jun 16 08:51:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-fe694751-5fd8-4a4a-9353-8d619d1d03d9 req-ba85fd1f-7e1c-4312-9c18-e92807d78824 tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:51:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-fe694751-5fd8-4a4a-9353-8d619d1d03d9 req-ba85fd1f-7e1c-4312-9c18-e92807d78824 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:51:46 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff473d22-d394-43cc-8bd2-7f853bcd837f]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:51:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-fe694751-5fd8-4a4a-9353-8d619d1d03d9 req-ba85fd1f-7e1c-4312-9c18-e92807d78824 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:46 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 Jun 16 08:51:46 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:46 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-fe694751-5fd8-4a4a-9353-8d619d1d03d9 req-ba85fd1f-7e1c-4312-9c18-e92807d78824 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0" returned: 0 in 0.817s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-fe694751-5fd8-4a4a-9353-8d619d1d03d9 req-ba85fd1f-7e1c-4312-9c18-e92807d78824 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:46 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 Jun 16 08:51:46 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:47 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-fe694751-5fd8-4a4a-9353-8d619d1d03d9 req-ba85fd1f-7e1c-4312-9c18-e92807d78824 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0" returned: 1 in 0.832s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-fe694751-5fd8-4a4a-9353-8d619d1d03d9 req-ba85fd1f-7e1c-4312-9c18-e92807d78824 tempest-TestInstancesWithCinderVolumes-778168295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:51:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-fe694751-5fd8-4a4a-9353-8d619d1d03d9 req-ba85fd1f-7e1c-4312-9c18-e92807d78824 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.700s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:51:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-fe694751-5fd8-4a4a-9353-8d619d1d03d9 req-ba85fd1f-7e1c-4312-9c18-e92807d78824 tempest-TestInstancesWithCinderVolumes-778168295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '148d6b20-5a88-45ce-98eb-3def7b675550', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:51:47 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-fe694751-5fd8-4a4a-9353-8d619d1d03d9 req-ba85fd1f-7e1c-4312-9c18-e92807d78824 tempest-TestInstancesWithCinderVolumes-778168295 None] attachment_update completed successfully. Jun 16 08:51:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-9306a30e-8735-4747-aac5-9fb676265da6 req-8eca266a-a2e5-47b2-bc9c-1645a541d067 tempest-TestServerVolumeAttachmentScenario-847416422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:51:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-9306a30e-8735-4747-aac5-9fb676265da6 req-8eca266a-a2e5-47b2-bc9c-1645a541d067 tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:51:52 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f10d50-ca85-4f3f-8dea-f6fcd1806824]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:51:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-9306a30e-8735-4747-aac5-9fb676265da6 req-8eca266a-a2e5-47b2-bc9c-1645a541d067 tempest-TestServerVolumeAttachmentScenario-847416422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:51:53 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f Jun 16 08:51:53 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:51:54 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Jun 16 08:51:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-9306a30e-8735-4747-aac5-9fb676265da6 req-8eca266a-a2e5-47b2-bc9c-1645a541d067 tempest-TestServerVolumeAttachmentScenario-847416422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f" returned: 0 in 1.569s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:51:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-9306a30e-8735-4747-aac5-9fb676265da6 req-8eca266a-a2e5-47b2-bc9c-1645a541d067 tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.622s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:51:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-9306a30e-8735-4747-aac5-9fb676265da6 req-8eca266a-a2e5-47b2-bc9c-1645a541d067 tempest-TestServerVolumeAttachmentScenario-847416422 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4cbf107a-c44c-4b66-aabd-d06d9eb48428', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:51:54 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-9306a30e-8735-4747-aac5-9fb676265da6 req-8eca266a-a2e5-47b2-bc9c-1645a541d067 tempest-TestServerVolumeAttachmentScenario-847416422 None] attachment_update completed successfully. Jun 16 08:52:04 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=57,cinder:UPDATE=39,cinder:INSERT=22,cinder:DELETE=2 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:52:04 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=49,cinder:UPDATE=47,cinder:INSERT=16,cinder:DELETE=5 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:52:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-a1b7d3fc-f524-4382-aa1b-66196871f417 req-0dca1ea0-0e9c-4069-9a97-c703448a12c3 tempest-TestServerVolumeAttachmentScenario-847416422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:52:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-a1b7d3fc-f524-4382-aa1b-66196871f417 req-0dca1ea0-0e9c-4069-9a97-c703448a12c3 tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:52:08 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[843b315d-478d-4b5d-9765-a3fbb5eb369c]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:52:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-a1b7d3fc-f524-4382-aa1b-66196871f417 req-0dca1ea0-0e9c-4069-9a97-c703448a12c3 tempest-TestServerVolumeAttachmentScenario-847416422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:08 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9 Jun 16 08:52:08 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:10 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-a1b7d3fc-f524-4382-aa1b-66196871f417 req-0dca1ea0-0e9c-4069-9a97-c703448a12c3 tempest-TestServerVolumeAttachmentScenario-847416422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9" returned: 0 in 2.006s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-a1b7d3fc-f524-4382-aa1b-66196871f417 req-0dca1ea0-0e9c-4069-9a97-c703448a12c3 tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.072s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:52:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-a1b7d3fc-f524-4382-aa1b-66196871f417 req-0dca1ea0-0e9c-4069-9a97-c703448a12c3 tempest-TestServerVolumeAttachmentScenario-847416422 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9545bb1e-1a13-4db2-97cc-848ba20479e4', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:52:10 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-a1b7d3fc-f524-4382-aa1b-66196871f417 req-0dca1ea0-0e9c-4069-9a97-c703448a12c3 tempest-TestServerVolumeAttachmentScenario-847416422 None] attachment_update completed successfully. Jun 16 08:52:19 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-fc98a9e6-45e2-4401-8616-6ae78a1e2fc8 req-6d777e38-9614-4358-811a-980c54bd124c tempest-TestServerVolumeAttachmentScenario-847416422 None] Terminate volume connection completed successfully. Jun 16 08:52:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-fc98a9e6-45e2-4401-8616-6ae78a1e2fc8 req-6d777e38-9614-4358-811a-980c54bd124c tempest-TestServerVolumeAttachmentScenario-847416422 None] Deleting attachment 9545bb1e-1a13-4db2-97cc-848ba20479e4. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:52:23 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-abc2cb9c-045d-4a94-829a-e56bce96c200 req-fc8e42d4-a88c-4107-80a8-ad28eb26aeda tempest-TestServerVolumeAttachmentScenario-847416422 None] Terminate volume connection completed successfully. Jun 16 08:52:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-abc2cb9c-045d-4a94-829a-e56bce96c200 req-fc8e42d4-a88c-4107-80a8-ad28eb26aeda tempest-TestServerVolumeAttachmentScenario-847416422 None] Deleting attachment 4cbf107a-c44c-4b66-aabd-d06d9eb48428. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:52:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-27f19204-6636-4ac7-adb8-9e76e54473cc req-4852d881-cb45-4995-8d02-e8b4e78b5b74 tempest-TestShelveInstance-1708714429 None] Terminate volume connection completed successfully. Jun 16 08:52:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-27f19204-6636-4ac7-adb8-9e76e54473cc req-4852d881-cb45-4995-8d02-e8b4e78b5b74 tempest-TestShelveInstance-1708714429 None] Deleting attachment dc112971-8906-4a2e-8e99-5a66fdb99318. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:52:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:52:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:52:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:52:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:52:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:52:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:52:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:30 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:52:30 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:30 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.597s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:30 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:52:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:52:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:52:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:52:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-eb9d5c54-734d-44e5-b3b5-ba7b781a6899 req-d730fa79-6287-4faf-b75b-bc0019852e73 tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:52:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-eb9d5c54-734d-44e5-b3b5-ba7b781a6899 req-d730fa79-6287-4faf-b75b-bc0019852e73 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:52:31 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[12626894-8c99-48c9-960b-41ded3ceb921]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:52:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-eb9d5c54-734d-44e5-b3b5-ba7b781a6899 req-d730fa79-6287-4faf-b75b-bc0019852e73 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:31 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc Jun 16 08:52:31 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:31 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-eb9d5c54-734d-44e5-b3b5-ba7b781a6899 req-d730fa79-6287-4faf-b75b-bc0019852e73 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc" returned: 0 in 0.785s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-eb9d5c54-734d-44e5-b3b5-ba7b781a6899 req-d730fa79-6287-4faf-b75b-bc0019852e73 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.813s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:52:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-eb9d5c54-734d-44e5-b3b5-ba7b781a6899 req-d730fa79-6287-4faf-b75b-bc0019852e73 tempest-TestInstancesWithCinderVolumes-778168295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a1ccd00-7b46-47d7-9331-ec4f06386312', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:52:31 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-eb9d5c54-734d-44e5-b3b5-ba7b781a6899 req-d730fa79-6287-4faf-b75b-bc0019852e73 tempest-TestInstancesWithCinderVolumes-778168295 None] attachment_update completed successfully. Jun 16 08:52:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-6a4d4b6b-df56-4be9-a95d-68a1c778822f req-eeaf6804-3167-4cb3-b62c-aa45ea2f7ad7 tempest-TestShelveInstance-1708714429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:52:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-6a4d4b6b-df56-4be9-a95d-68a1c778822f req-eeaf6804-3167-4cb3-b62c-aa45ea2f7ad7 tempest-TestShelveInstance-1708714429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:52:33 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ffde2f-b0e5-42d2-b41a-79025a1939c3]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:52:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-6a4d4b6b-df56-4be9-a95d-68a1c778822f req-eeaf6804-3167-4cb3-b62c-aa45ea2f7ad7 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:33 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff Jun 16 08:52:33 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:34 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-6a4d4b6b-df56-4be9-a95d-68a1c778822f req-eeaf6804-3167-4cb3-b62c-aa45ea2f7ad7 tempest-TestShelveInstance-1708714429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff" returned: 0 in 0.751s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-6a4d4b6b-df56-4be9-a95d-68a1c778822f req-eeaf6804-3167-4cb3-b62c-aa45ea2f7ad7 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:34 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff Jun 16 08:52:34 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:34 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] Acquiring lock "cinder-ab78fbdc-ee7f-43b5-a722-1870d1b227f9-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:52:34 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "cinder-ab78fbdc-ee7f-43b5-a722-1870d1b227f9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:52:34 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] Acquiring lock "cinder-quobyte-ab78fbdc-ee7f-43b5-a722-1870d1b227f9" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:52:34 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "cinder-quobyte-ab78fbdc-ee7f-43b5-a722-1870d1b227f9" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:52:34 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bed5cf8-5fe0-47c4-9281-80c0131447ef]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:52:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:34 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9 Jun 16 08:52:34 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:35 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-6a4d4b6b-df56-4be9-a95d-68a1c778822f req-eeaf6804-3167-4cb3-b62c-aa45ea2f7ad7 tempest-TestShelveInstance-1708714429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff" returned: 1 in 0.759s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-6a4d4b6b-df56-4be9-a95d-68a1c778822f req-eeaf6804-3167-4cb3-b62c-aa45ea2f7ad7 tempest-TestShelveInstance-1708714429 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:52:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-6a4d4b6b-df56-4be9-a95d-68a1c778822f req-eeaf6804-3167-4cb3-b62c-aa45ea2f7ad7 tempest-TestShelveInstance-1708714429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.561s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:52:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-6a4d4b6b-df56-4be9-a95d-68a1c778822f req-eeaf6804-3167-4cb3-b62c-aa45ea2f7ad7 tempest-TestShelveInstance-1708714429 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7b8f015-bcbb-466d-ab06-a27a4537c126', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:52:35 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-6a4d4b6b-df56-4be9-a95d-68a1c778822f req-eeaf6804-3167-4cb3-b62c-aa45ea2f7ad7 tempest-TestShelveInstance-1708714429 None] attachment_update completed successfully. Jun 16 08:52:35 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9" returned: 0 in 0.756s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:35 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9 Jun 16 08:52:35 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:36 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ab78fbdc-ee7f-43b5-a722-1870d1b227f9" returned: 0 in 0.598s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "cinder-quobyte-ab78fbdc-ee7f-43b5-a722-1870d1b227f9" released by "delete_volume" :: held 1.393s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] Created reservations ['b3bd79dd-c74e-4497-a399-c10f82d8b0b2', '6b6ea314-a501-4621-91e6-20af4ff1f33a', 'ed40e0e4-053c-4fa7-bf3e-4925e3b6c60c', '61ac25e1-d3d0-4047-8319-15dc82e1e632'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:36 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:52:36 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] Acquiring lock "cinder-e058f7f6-3f86-4b34-a54d-208bdbe8399f-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:52:36 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.677s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:52:36 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] Deleted volume successfully. Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "cinder-e058f7f6-3f86-4b34-a54d-208bdbe8399f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cad76c74-a2a8-42a1-9069-cf454391d199 tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "cinder-ab78fbdc-ee7f-43b5-a722-1870d1b227f9-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] Acquiring lock "cinder-quobyte-e058f7f6-3f86-4b34-a54d-208bdbe8399f" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "cinder-quobyte-e058f7f6-3f86-4b34-a54d-208bdbe8399f" acquired by "delete_volume" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebb5443-cf48-4e9d-8a36-3a6e73216df6]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:52:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:37 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f Jun 16 08:52:37 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:37 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f" returned: 0 in 0.746s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:37 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f Jun 16 08:52:37 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:38 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e058f7f6-3f86-4b34-a54d-208bdbe8399f" returned: 0 in 0.599s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "cinder-quobyte-e058f7f6-3f86-4b34-a54d-208bdbe8399f" released by "delete_volume" :: held 1.390s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:52:38 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] Created reservations ['2e798314-df77-430a-a619-2cd2f1999804', 'd8f65b05-294c-432f-a35b-f7efa201782a', 'b718fbe7-6ed0-433f-9242-cb302812971f', '380e2b56-97a4-4602-add8-cdcec987a17e'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:52:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:52:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:52:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:52:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:52:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:52:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:38 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:52:38 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:39 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.623s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:39 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:52:39 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] Deleted volume successfully. Jun 16 08:52:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7f60ab26-10b1-4ff5-a44d-addf6581018b tempest-TestServerVolumeAttachmentScenario-847416422 None] Lock "cinder-e058f7f6-3f86-4b34-a54d-208bdbe8399f-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:52:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-217d7137-3f9f-4882-8dfa-bdfd5ad100d7 req-439c34f4-3be4-401a-847a-3429801d4acf tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:52:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-217d7137-3f9f-4882-8dfa-bdfd5ad100d7 req-439c34f4-3be4-401a-847a-3429801d4acf tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:52:39 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e53e5e3-7630-4e47-b79a-ac784337e76a]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:52:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-217d7137-3f9f-4882-8dfa-bdfd5ad100d7 req-439c34f4-3be4-401a-847a-3429801d4acf tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:39 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd Jun 16 08:52:39 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:40 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-217d7137-3f9f-4882-8dfa-bdfd5ad100d7 req-439c34f4-3be4-401a-847a-3429801d4acf tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd" returned: 0 in 0.778s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-217d7137-3f9f-4882-8dfa-bdfd5ad100d7 req-439c34f4-3be4-401a-847a-3429801d4acf tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.799s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-217d7137-3f9f-4882-8dfa-bdfd5ad100d7 req-439c34f4-3be4-401a-847a-3429801d4acf tempest-TestInstancesWithCinderVolumes-778168295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7798e417-88a3-4e3d-8175-b97a5095ffe9', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:52:40 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-217d7137-3f9f-4882-8dfa-bdfd5ad100d7 req-439c34f4-3be4-401a-847a-3429801d4acf tempest-TestInstancesWithCinderVolumes-778168295 None] attachment_update completed successfully. Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Flow 'volume_create_manager' (4837e77e-1e39-495e-9cb5-381696475afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac69b79c-d88b-40f2-8618-f3983285690a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac69b79c-d88b-40f2-8618-f3983285690a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1090007577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5af230-d83c-43a7-9a87-ce6069d9f21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3a28b928ea44198b889318381baa1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:52:41Z,use_quota=True,user_id='d08d34b98eac4df199376dddad734b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808e63e5-4185-4c05-8db6-43e508c35113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808e63e5-4185-4c05-8db6-43e508c35113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556b9e70-7b98-4635-b3e7-b77c7d40bdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556b9e70-7b98-4635-b3e7-b77c7d40bdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a5af230-d83c-43a7-9a87-ce6069d9f21b', 'volume_name': 'volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08133b4-b1fa-4b80-8636-e5e820b05c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08133b4-b1fa-4b80-8636-e5e820b05c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69134a63-bd05-4eb6-8e29-3b2d933c9aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:52:40 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Volume 4a5af230-d83c-43a7-9a87-ce6069d9f21b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b', 'volume_size': 1} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1090007577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5af230-d83c-43a7-9a87-ce6069d9f21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3a28b928ea44198b889318381baa1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:52:41Z,use_quota=True,user_id='d08d34b98eac4df199376dddad734b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Creating volume 4a5af230-d83c-43a7-9a87-ce6069d9f21b {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:52:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:52:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:52:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:52:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:52:41 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:52:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:41 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b 1073741824 Jun 16 08:52:41 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:41 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b 1073741824" returned: 0 in 0.932s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:42 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b Jun 16 08:52:42 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:42 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b" returned: 0 in 0.735s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:52:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:52:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69134a63-bd05-4eb6-8e29-3b2d933c9aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:52:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ea90da-de51-4b42-bbc9-83c381de372c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:52:42 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Volume volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b (4a5af230-d83c-43a7-9a87-ce6069d9f21b): created successfully Jun 16 08:52:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ea90da-de51-4b42-bbc9-83c381de372c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:52:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Flow 'volume_create_manager' (4837e77e-1e39-495e-9cb5-381696475afc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:52:42 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ae095a98-7659-4daa-8584-5faaf37aeaf1 tempest-AttachVolumeNegativeTest-838816842 None] Created volume successfully. Jun 16 08:52:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-d9a7df1e-5f28-4e18-8154-af0bfe594841 req-a688d5f2-0405-4e70-9990-7bb518cc9ba2 tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:52:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-d9a7df1e-5f28-4e18-8154-af0bfe594841 req-a688d5f2-0405-4e70-9990-7bb518cc9ba2 tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:52:46 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[139416c7-f6b3-4c5c-a4fe-2cc1bd336108]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:52:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-d9a7df1e-5f28-4e18-8154-af0bfe594841 req-a688d5f2-0405-4e70-9990-7bb518cc9ba2 tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:46 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b Jun 16 08:52:46 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:47 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-d9a7df1e-5f28-4e18-8154-af0bfe594841 req-a688d5f2-0405-4e70-9990-7bb518cc9ba2 tempest-AttachVolumeNegativeTest-838816842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b" returned: 0 in 1.323s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-d9a7df1e-5f28-4e18-8154-af0bfe594841 req-a688d5f2-0405-4e70-9990-7bb518cc9ba2 tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.359s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:52:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-d9a7df1e-5f28-4e18-8154-af0bfe594841 req-a688d5f2-0405-4e70-9990-7bb518cc9ba2 tempest-AttachVolumeNegativeTest-838816842 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f214c66-3dd3-4df5-855a-a6e8f135f8c3', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:52:47 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-d9a7df1e-5f28-4e18-8154-af0bfe594841 req-a688d5f2-0405-4e70-9990-7bb518cc9ba2 tempest-AttachVolumeNegativeTest-838816842 None] attachment_update completed successfully. Jun 16 08:52:51 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-ac503531-e640-4115-b9ef-0298d9ecddbc req-dfa3ef1d-8bfc-45fd-b608-9482f24c41d3 tempest-TestInstancesWithCinderVolumes-778168295 None] Terminate volume connection completed successfully. Jun 16 08:52:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-ac503531-e640-4115-b9ef-0298d9ecddbc req-dfa3ef1d-8bfc-45fd-b608-9482f24c41d3 tempest-TestInstancesWithCinderVolumes-778168295 None] Deleting attachment 6a1ccd00-7b46-47d7-9331-ec4f06386312. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:52:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "cinder-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:52:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "cinder-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:52:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "cinder-quobyte-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:52:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "cinder-quobyte-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc" acquired by "delete_volume" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:52:53 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[331c0f3d-1ecd-42d7-afeb-9795ebc6b80d]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:52:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:53 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc Jun 16 08:52:53 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:54 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc" returned: 0 in 1.246s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:54 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc Jun 16 08:52:54 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:55 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc" returned: 0 in 0.921s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "cinder-quobyte-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc" released by "delete_volume" :: held 2.234s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:52:55 devstack cinder-volume[92348]: WARNING cinder.quota [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-527842707-187386709 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-527842707-187386709, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:52:55 devstack cinder-volume[92348]: WARNING cinder.quota [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-527842707-187386709 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-527842707-187386709, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:52:55 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Created reservations ['8e6e8450-515f-4e00-948e-684c4622ccaf', 'bfd46845-2e0a-4723-9a83-de6452525f34', '6b61867b-317e-441e-9ede-6ef1898950d7', 'c5d6dc05-bc54-4f57-b862-439b262a5218'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:52:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:52:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:52:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:52:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:52:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:52:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:52:55 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:52:55 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:52:56 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Jun 16 08:52:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.854s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:52:56 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:52:56 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Deleted volume successfully. Jun 16 08:52:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2b8307c3-b465-4baa-8c19-41aa96378b67 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "cinder-53e02a0b-25bf-4a7d-a6f7-7df3e42a65dc-delete_volume" released by "delete_volume" :: held 3.516s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:52:59 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-aff63d10-4dfa-49f8-931d-021dcc8a204a req-0f5a9bf8-5fdd-43ec-b4fe-098d42464302 tempest-TestInstancesWithCinderVolumes-778168295 None] Terminate volume connection completed successfully. Jun 16 08:52:59 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-aff63d10-4dfa-49f8-931d-021dcc8a204a req-0f5a9bf8-5fdd-43ec-b4fe-098d42464302 tempest-TestInstancesWithCinderVolumes-778168295 None] Deleting attachment 7798e417-88a3-4e3d-8175-b97a5095ffe9. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:53:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "cinder-7de8ef1e-2f00-46e3-8eaf-779830e370dd-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:53:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "cinder-7de8ef1e-2f00-46e3-8eaf-779830e370dd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:53:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "cinder-quobyte-7de8ef1e-2f00-46e3-8eaf-779830e370dd" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:53:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "cinder-quobyte-7de8ef1e-2f00-46e3-8eaf-779830e370dd" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:53:01 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d89b97b-86f6-48d9-a1b8-9cc9123c37b5]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:53:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:01 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd Jun 16 08:53:01 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:02 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd" returned: 0 in 1.026s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:02 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd Jun 16 08:53:02 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7de8ef1e-2f00-46e3-8eaf-779830e370dd" returned: 0 in 1.155s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:03 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "cinder-quobyte-7de8ef1e-2f00-46e3-8eaf-779830e370dd" released by "delete_volume" :: held 2.269s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:53:03 devstack cinder-volume[92348]: WARNING cinder.quota [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-591417271-1458102309 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-591417271-1458102309, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:53:03 devstack cinder-volume[92348]: WARNING cinder.quota [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-591417271-1458102309 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-591417271-1458102309, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:53:03 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Created reservations ['8d4c0a36-ef36-4db9-9e66-7730bfdf49f0', 'e3edfb4e-fd66-4f2b-a479-f1ef6d5e43e4', '381d921c-0ca0-4e8f-9e38-cb3eafa70980', '174b578a-1d67-4918-86f9-6fbaffdfe4f8'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:53:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:53:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:53:03 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:53:03 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:53:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:53:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:03 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:53:03 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:04 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.902s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:04 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:53:04 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Deleted volume successfully. Jun 16 08:53:04 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=44,cinder:UPDATE=48,cinder:INSERT=8,cinder:DELETE=5 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:53:04 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-33d4a629-7e4d-4d58-ac2d-130ba37a6717 tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "cinder-7de8ef1e-2f00-46e3-8eaf-779830e370dd-delete_volume" released by "delete_volume" :: held 3.456s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:53:09 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=67,cinder:UPDATE=38,cinder:INSERT=9 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:53:09 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-4fd29be5-9941-48d2-9d56-21d4a4ac1b38 req-ee523612-64af-4999-b3f5-2fa80fbc731d tempest-TestInstancesWithCinderVolumes-778168295 None] Terminate volume connection completed successfully. Jun 16 08:53:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-4fd29be5-9941-48d2-9d56-21d4a4ac1b38 req-ee523612-64af-4999-b3f5-2fa80fbc731d tempest-TestInstancesWithCinderVolumes-778168295 None] Deleting attachment 148d6b20-5a88-45ce-98eb-3def7b675550. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:53:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "cinder-24dc7a33-ec09-4693-8b18-fcec3dc740d0-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:53:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "cinder-24dc7a33-ec09-4693-8b18-fcec3dc740d0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:53:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "cinder-quobyte-24dc7a33-ec09-4693-8b18-fcec3dc740d0" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:53:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "cinder-quobyte-24dc7a33-ec09-4693-8b18-fcec3dc740d0" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:53:13 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cab5d7-1615-442d-a60d-4bab5d7f2984]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:53:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:13 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 Jun 16 08:53:13 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:14 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0" returned: 0 in 1.050s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:14 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 Jun 16 08:53:14 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:15 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0" returned: 1 in 0.927s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:53:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:15 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0 Jun 16 08:53:15 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:16 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-24dc7a33-ec09-4693-8b18-fcec3dc740d0" returned: 0 in 1.170s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "cinder-quobyte-24dc7a33-ec09-4693-8b18-fcec3dc740d0" released by "delete_volume" :: held 3.255s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:53:16 devstack cinder-volume[92348]: WARNING cinder.quota [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1317253892-1560719323 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1317253892-1560719323, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:53:16 devstack cinder-volume[92348]: WARNING cinder.quota [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1317253892-1560719323 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1317253892-1560719323, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:53:16 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Created reservations ['d429d1fb-bf17-4ad4-a0fa-2d89480aa08f', '3a65d887-385b-4980-963f-6ea0a3ef69d0', '78505692-7a45-4714-8d65-aa2d39849e5e', 'd2b55019-d0ad-474b-bf87-a1e5853a5a1f'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:53:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:53:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:53:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:53:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:53:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:53:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:16 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:53:16 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:17 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.815s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:17 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:53:17 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Deleted volume successfully. Jun 16 08:53:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2e2adaf7-f552-481b-86c7-c3bb207a5dde tempest-TestInstancesWithCinderVolumes-778168295 None] Lock "cinder-24dc7a33-ec09-4693-8b18-fcec3dc740d0-delete_volume" released by "delete_volume" :: held 4.400s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Flow 'volume_create_manager' (cba82b94-6a91-4071-9f09-22ee16e409c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a1dc91-1844-4cf5-81a2-b0000c3eaaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a1dc91-1844-4cf5-81a2-b0000c3eaaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-381445243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2158fb41-53fa-40c4-aa9a-8eab903c44ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df011d3426044334bc342df2740ba4c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:53:22Z,use_quota=True,user_id='2ac379b3791a4836970c1027d0a0f76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150adb94-3f2d-44ac-a784-a9d8cf3e5eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150adb94-3f2d-44ac-a784-a9d8cf3e5eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5606f27-32fa-4213-bcdb-5fca4da692e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5606f27-32fa-4213-bcdb-5fca4da692e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2158fb41-53fa-40c4-aa9a-8eab903c44ee', 'volume_name': 'volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240ffd8e-18eb-42b0-ab68-daafcbdab403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240ffd8e-18eb-42b0-ab68-daafcbdab403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8619d5f2-ccb1-4ddb-a16d-e2d755f07e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:21 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Volume 2158fb41-53fa-40c4-aa9a-8eab903c44ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee', 'volume_size': 1} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-381445243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2158fb41-53fa-40c4-aa9a-8eab903c44ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df011d3426044334bc342df2740ba4c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:53:22Z,use_quota=True,user_id='2ac379b3791a4836970c1027d0a0f76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Creating volume 2158fb41-53fa-40c4-aa9a-8eab903c44ee {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:53:21 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:53:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:21 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee 1073741824 Jun 16 08:53:21 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:23 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee 1073741824" returned: 0 in 1.360s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:23 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee Jun 16 08:53:23 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:24 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee" returned: 0 in 0.920s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:24 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] <== create_volume: return (2340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:53:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.343s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:53:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8619d5f2-ccb1-4ddb-a16d-e2d755f07e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0415986-2c67-4ee8-a073-93e33b94241b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:24 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Volume volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee (2158fb41-53fa-40c4-aa9a-8eab903c44ee): created successfully Jun 16 08:53:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0415986-2c67-4ee8-a073-93e33b94241b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Flow 'volume_create_manager' (cba82b94-6a91-4071-9f09-22ee16e409c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:53:24 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-07b85aa4-6ad6-4359-9f83-797241b37e9a tempest-TestStampPattern-772327495 None] Created volume successfully. Jun 16 08:53:30 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-7569747e-99ec-4175-96e7-ef18edcd6d81 tempest-TestShelveInstance-1708714429 None] Terminate volume connection completed successfully. Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-7569747e-99ec-4175-96e7-ef18edcd6d81 tempest-TestShelveInstance-1708714429 None] Deleting attachment f7b8f015-bcbb-466d-ab06-a27a4537c126. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:30 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:53:30 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Acquiring lock "cinder-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Lock "cinder-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Lock "cinder-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Acquiring lock "cinder-quobyte-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Lock "cinder-quobyte-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff" acquired by "delete_volume" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.723s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:53:30 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ae00c7-38e2-4402-9cc4-4ccc0081a1cf]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:53:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:31 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff Jun 16 08:53:31 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:31 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff" returned: 0 in 0.829s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:31 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff Jun 16 08:53:31 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Flow 'volume_create_manager' (52cc0ce5-7dde-4902-8621-1c7a44c8db1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f59f35-489f-498e-aef9-21b3c7068d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f59f35-489f-498e-aef9-21b3c7068d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1218382569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f77cb0a-aba3-4c26-ac93-d9475e93463e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3d736998e914300877107e5be928c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:53:32Z,use_quota=True,user_id='80919b170c194d8a94201a8ea118cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79647ee-a3b4-446e-91f7-94b5b76a5b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79647ee-a3b4-446e-91f7-94b5b76a5b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b465bbca-20c6-4d60-b2a3-f5547ef18714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b465bbca-20c6-4d60-b2a3-f5547ef18714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f77cb0a-aba3-4c26-ac93-d9475e93463e', 'volume_name': 'volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e96ca9-1f97-4d06-b743-8003b60f4afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e96ca9-1f97-4d06-b743-8003b60f4afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471dc1c6-f599-4394-88b9-885a736be724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:32 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Volume 3f77cb0a-aba3-4c26-ac93-d9475e93463e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e', 'volume_size': 1} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1218382569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f77cb0a-aba3-4c26-ac93-d9475e93463e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3d736998e914300877107e5be928c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:53:32Z,use_quota=True,user_id='80919b170c194d8a94201a8ea118cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Creating volume 3f77cb0a-aba3-4c26-ac93-d9475e93463e {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:53:32 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:32 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e 1073741824 Jun 16 08:53:32 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:32 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff" returned: 1 in 0.895s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:53:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:32 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff Jun 16 08:53:32 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:33 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e 1073741824" returned: 0 in 0.954s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:33 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff" returned: 0 in 0.878s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:33 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Lock "cinder-quobyte-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff" released by "delete_volume" :: held 2.720s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:53:33 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e Jun 16 08:53:33 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:33 devstack cinder-volume[92348]: DEBUG cinder.quota [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Created reservations ['306d3782-f345-4284-9ea5-2a57a012cbbf', 'ed914ea1-662d-4d0d-80ef-d64d2eba3fea', 'e284c44a-25f9-4985-86b3-2890ea9166c7', 'e25b6736-677f-4dfa-b375-a31865115a97'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:53:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:53:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:53:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:53:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:53:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:53:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:33 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:53:33 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:34 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e" returned: 0 in 1.021s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:53:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:53:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471dc1c6-f599-4394-88b9-885a736be724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1c7d77-9366-4e76-b382-cb3c84f0956e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:34 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Volume volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e (3f77cb0a-aba3-4c26-ac93-d9475e93463e): created successfully Jun 16 08:53:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1c7d77-9366-4e76-b382-cb3c84f0956e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Flow 'volume_create_manager' (52cc0ce5-7dde-4902-8621-1c7a44c8db1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:53:34 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-96c0fb98-2bf4-481c-a9e4-6d46e9b2b25b tempest-VolumeDependencyTests-1155987697 None] Created volume successfully. Jun 16 08:53:34 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.211s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:34 devstack cinder-volume[92348]: DEBUG cinder.manager [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:53:34 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Deleted volume successfully. Jun 16 08:53:35 devstack cinder-volume[92348]: DEBUG cinder.coordination [req-9492da3b-c6ac-4a39-b5ce-c18f918de082 req-61dbd02d-bf3f-4d53-89a4-56cf8526a4a6 tempest-TestShelveInstance-1708714429 None] Lock "cinder-33f78f2b-ca3e-4b32-bcb1-4a53f9964cff-delete_volume" released by "delete_volume" :: held 4.222s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:53:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:53:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:53:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] Creating offline snapshot 3ab00184-e9bb-4656-9cc7-5a1cff0a590b of volume 3f77cb0a-aba3-4c26-ac93-d9475e93463e {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:53:35 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bc5b3d-da50-4a83-9de0-c718b7b33fbb]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:53:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:36 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e Jun 16 08:53:36 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:36 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e" returned: 0 in 0.864s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:36 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b 1G Jun 16 08:53:36 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:37 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b 1G" returned: 0 in 0.928s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:37 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b Jun 16 08:53:37 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:38 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b" returned: 0 in 0.930s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:38 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b is being set with open permissions: ugo+rw Jun 16 08:53:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:38 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b Jun 16 08:53:38 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:39 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b" returned: 0 in 0.787s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:39 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.info Jun 16 08:53:39 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:40 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.info" returned: 0 in 0.871s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:40 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.info is being set with open permissions: ugo+rw Jun 16 08:53:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:40 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.info Jun 16 08:53:40 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:41 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.info" returned: 0 in 1.146s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.684s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:53:41 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c2519278-aa0b-4581-bf2d-f6582d19112b tempest-VolumeDependencyTests-1155987697 None] Create snapshot completed successfully Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Flow 'volume_create_manager' (87a41186-4896-47ac-9da8-83f8940d0cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a061db7-ac69-418f-b155-0a626077111d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a061db7-ac69-418f-b155-0a626077111d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1875562756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330d5458-65a3-46aa-963a-30f6e1f7a50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3d736998e914300877107e5be928c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3ab00184-e9bb-4656-9cc7-5a1cff0a590b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:53:43Z,use_quota=True,user_id='80919b170c194d8a94201a8ea118cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65dbc533-7582-404a-8692-91c9e27963a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65dbc533-7582-404a-8692-91c9e27963a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad174632-cf5d-45a4-a011-852f27b5d1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad174632-cf5d-45a4-a011-852f27b5d1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '330d5458-65a3-46aa-963a-30f6e1f7a50c', 'volume_name': 'volume-330d5458-65a3-46aa-963a-30f6e1f7a50c', 'volume_size': 1, 'snapshot_id': '3ab00184-e9bb-4656-9cc7-5a1cff0a590b'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d8c694-e9ec-4a34-b7db-eecd78ad0c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d8c694-e9ec-4a34-b7db-eecd78ad0c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f1ac04-4b61-4944-943e-53f44c764e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:43 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Volume 330d5458-65a3-46aa-963a-30f6e1f7a50c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-330d5458-65a3-46aa-963a-30f6e1f7a50c', 'volume_size': 1, 'snapshot_id': '3ab00184-e9bb-4656-9cc7-5a1cff0a590b'} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Acquiring lock "cinder-quobyte-3ab00184-e9bb-4656-9cc7-5a1cff0a590b-330d5458-65a3-46aa-963a-30f6e1f7a50c" by "_create_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-quobyte-3ab00184-e9bb-4656-9cc7-5a1cff0a590b-330d5458-65a3-46aa-963a-30f6e1f7a50c" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Creating volume 330d5458-65a3-46aa-963a-30f6e1f7a50c from snapshot 3ab00184-e9bb-4656-9cc7-5a1cff0a590b {{(pid=92348) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Acquiring lock "cinder-quobyte-330d5458-65a3-46aa-963a-30f6e1f7a50c" by "_copy_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-quobyte-330d5458-65a3-46aa-963a-30f6e1f7a50c" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] snapshot: 3ab00184-e9bb-4656-9cc7-5a1cff0a590b, volume: 330d5458-65a3-46aa-963a-30f6e1f7a50c, {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[862fb021-b241-44de-b64c-6b4b69b5571c]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:53:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:43 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b Jun 16 08:53:43 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:44 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b" returned: 0 in 1.065s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:53:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 16 08:53:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Creating direct copy from snapshot {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 16 08:53:44 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5641eba4-cff4-4a25-92a1-77583164e0b3]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:53:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:44 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e Jun 16 08:53:44 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:45 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e" returned: 0 in 1.021s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:45 devstack cinder-volume[92348]: DEBUG cinder.utils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Path /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-330d5458-65a3-46aa-963a-30f6e1f7a50c not found in is_blk_device check {{(pid=92348) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 16 08:53:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-330d5458-65a3-46aa-963a-30f6e1f7a50c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:45 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-330d5458-65a3-46aa-963a-30f6e1f7a50c Jun 16 08:53:45 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:51 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-330d5458-65a3-46aa-963a-30f6e1f7a50c" returned: 0 in 6.314s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:51 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff32d68e-b422-4a20-8d87-158fbf3ca351]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:53:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:52 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e Jun 16 08:53:52 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:52 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-4ce6d2a4-3760-4e08-9968-4473b2af4853 req-4fe9f7d4-2057-4c80-a6f8-c9c86505ea46 tempest-AttachVolumeNegativeTest-838816842 None] Terminate volume connection completed successfully. Jun 16 08:53:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-4ce6d2a4-3760-4e08-9968-4473b2af4853 req-4fe9f7d4-2057-4c80-a6f8-c9c86505ea46 tempest-AttachVolumeNegativeTest-838816842 None] Deleting attachment 7f214c66-3dd3-4df5-855a-a6e8f135f8c3. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:53:52 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e" returned: 0 in 0.885s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:52 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e, size 1024.00 MB, duration 6.31 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-330d5458-65a3-46aa-963a-30f6e1f7a50c {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:53:52 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Converted 1024.00 MB image at 162.16 MB/s Jun 16 08:53:52 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-330d5458-65a3-46aa-963a-30f6e1f7a50c is being set with open permissions: ugo+rw Jun 16 08:53:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-330d5458-65a3-46aa-963a-30f6e1f7a50c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:52 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-330d5458-65a3-46aa-963a-30f6e1f7a50c Jun 16 08:53:52 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:53 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-330d5458-65a3-46aa-963a-30f6e1f7a50c" returned: 0 in 0.598s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-quobyte-330d5458-65a3-46aa-963a-30f6e1f7a50c" released by "_copy_volume_from_snapshot" :: held 10.028s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:53:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-quobyte-3ab00184-e9bb-4656-9cc7-5a1cff0a590b-330d5458-65a3-46aa-963a-30f6e1f7a50c" released by "_create_volume_from_snapshot" :: held 10.071s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:53:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.099s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:53:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f1ac04-4b61-4944-943e-53f44c764e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-330d5458-65a3-46aa-963a-30f6e1f7a50c', 'volume_size': 1, 'snapshot_id': '3ab00184-e9bb-4656-9cc7-5a1cff0a590b'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ad4d31-7d6e-43ba-ad3a-bb6320a99145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:53 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Volume volume-330d5458-65a3-46aa-963a-30f6e1f7a50c (330d5458-65a3-46aa-963a-30f6e1f7a50c): created successfully Jun 16 08:53:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ad4d31-7d6e-43ba-ad3a-bb6320a99145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Flow 'volume_create_manager' (87a41186-4896-47ac-9da8-83f8940d0cce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:53:53 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-f41e3f50-5c2a-4baa-8009-0b9ac2da79c2 tempest-VolumeDependencyTests-1155987697 None] Created volume successfully. Jun 16 08:53:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] Acquiring lock "cinder-3ab00184-e9bb-4656-9cc7-5a1cff0a590b-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:53:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-3ab00184-e9bb-4656-9cc7-5a1cff0a590b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:53:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] Acquiring lock "cinder-quobyte-3f77cb0a-aba3-4c26-ac93-d9475e93463e" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:53:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-quobyte-3f77cb0a-aba3-4c26-ac93-d9475e93463e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:53:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] Acquiring lock "cinder-quobyte-3ab00184-e9bb-4656-9cc7-5a1cff0a590b" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:53:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-quobyte-3ab00184-e9bb-4656-9cc7-5a1cff0a590b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:53:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] Deleting offline snapshot 3ab00184-e9bb-4656-9cc7-5a1cff0a590b of volume 3f77cb0a-aba3-4c26-ac93-d9475e93463e {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:53:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] snapshot_file for this snap is: volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:53:54 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbd46b3-3cb0-4eff-937f-4bea6aa2adbb]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:53:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:54 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b Jun 16 08:53:54 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:55 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b" returned: 0 in 0.967s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:53:55 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6d7edd-6d3c-48df-af4c-75d265385d51]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:53:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:55 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e Jun 16 08:53:55 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:56 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e" returned: 0 in 1.046s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:56 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b Jun 16 08:53:56 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Flow 'volume_create_manager' (7eedea24-75ba-4592-a738-6f309bc2b43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1e1d51-4c05-4144-bf84-585a8416908d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1e1d51-4c05-4144-bf84-585a8416908d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd93cc2-8b92-4287-b2e4-4808ad2b82dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef464e58856f4dceb335413b03daa141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:53:57Z,use_quota=True,user_id='c9e1a217d3db4831b274226220884774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efab8375-3d3f-4cb4-8521-fd47512dd89f),volume_type_id=efab8375-3d3f-4cb4-8521-fd47512dd89f)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2059c3-01f0-482a-b6df-f14968629e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2059c3-01f0-482a-b6df-f14968629e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064b1ea6-32b5-4d19-be1c-6d7eef8531a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG cinder.image.glance [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Creating Keystone auth plugin from conf {{(pid=92348) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 16 08:53:57 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b" returned: 0 in 1.021s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064b1ea6-32b5-4d19-be1c-6d7eef8531a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cbd93cc2-8b92-4287-b2e4-4808ad2b82dd', 'volume_name': 'volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd', 'volume_size': 1, 'image_id': 'fb5b0974-f2b0-448b-b25d-103b6e2b83d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb5b0974-f2b0-448b-b25d-103b6e2b83d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff663255e7e1852e95e8d941f0ef2c9e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef464e58856f4dceb335413b03daa141', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e279fe7d6c052960d313846f715c54f79b900f43e5c089db9270eb726b2f1b66b1473a8a4ffb1fac5cfee278c7e1e25fd41025b4ad0031f3d3c6950eeca654f', 'id': 'fb5b0974-f2b0-448b-b25d-103b6e2b83d2', 'created_at': datetime.datetime(2026, 6, 16, 6, 53, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 53, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb5b0974-f2b0-448b-b25d-103b6e2b83d2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa8dfbb-f0bd-4b86-916f-a1fd688df2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:57 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b Jun 16 08:53:57 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa8dfbb-f0bd-4b86-916f-a1fd688df2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8f50cc-bec7-4910-a24d-1ad3ef69d4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:53:57 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Volume cbd93cc2-8b92-4287-b2e4-4808ad2b82dd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd', 'volume_size': 1, 'image_id': 'fb5b0974-f2b0-448b-b25d-103b6e2b83d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb5b0974-f2b0-448b-b25d-103b6e2b83d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff663255e7e1852e95e8d941f0ef2c9e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef464e58856f4dceb335413b03daa141', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e279fe7d6c052960d313846f715c54f79b900f43e5c089db9270eb726b2f1b66b1473a8a4ffb1fac5cfee278c7e1e25fd41025b4ad0031f3d3c6950eeca654f', 'id': 'fb5b0974-f2b0-448b-b25d-103b6e2b83d2', 'created_at': datetime.datetime(2026, 6, 16, 6, 53, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 53, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb5b0974-f2b0-448b-b25d-103b6e2b83d2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Trying to clone cbd93cc2-8b92-4287-b2e4-4808ad2b82dd from image fb5b0974-f2b0-448b-b25d-103b6e2b83d2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fb5b0974-f2b0-448b-b25d-103b6e2b83d2', 'metadata': {}}]). {{(pid=92348) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 16 08:53:57 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Image download 0.00 MB at 0.00 MB/s Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e78e472-f1c9-4e78-ade0-3d0db4ae61b8]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:53:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:58 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD Jun 16 08:53:58 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:58 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e.3ab00184-e9bb-4656-9cc7-5a1cff0a590b" returned: 0 in 0.708s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-quobyte-3ab00184-e9bb-4656-9cc7-5a1cff0a590b" released by "_delete_snapshot" :: held 3.928s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:53:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-quobyte-3f77cb0a-aba3-4c26-ac93-d9475e93463e" released by "delete_snapshot" :: held 3.964s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:53:58 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] Created reservations ['6bcca2e3-207c-4949-b4f3-54c2baca392a', '3780ae06-46f1-4a83-a2e7-8af44870bd62', 'a581e0f6-d365-4e11-8af6-c92d10207ae7', '80f13ad0-732f-4124-ac78-13d3b3a53420'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:53:58 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] Delete snapshot completed successfully. Jun 16 08:53:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6225e67f-6791-4539-a4e9-6f9fd8179246 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-3ab00184-e9bb-4656-9cc7-5a1cff0a590b-delete_snapshot" released by "delete_snapshot" :: held 4.106s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:53:58 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD" returned: 0 in 0.691s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] Acquiring lock "cinder-3f77cb0a-aba3-4c26-ac93-d9475e93463e-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:53:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-3f77cb0a-aba3-4c26-ac93-d9475e93463e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:53:58 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD Jun 16 08:53:58 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] Acquiring lock "cinder-quobyte-3f77cb0a-aba3-4c26-ac93-d9475e93463e" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:53:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-quobyte-3f77cb0a-aba3-4c26-ac93-d9475e93463e" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:53:58 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1a960c-fe43-4cc9-b9f6-bf267dc8ef5c]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:53:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:58 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e Jun 16 08:53:58 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:59 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD" returned: 1 in 0.717s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:53:59 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Temporary image fb5b0974-f2b0-448b-b25d-103b6e2b83d2 is fetched for user c9e1a217d3db4831b274226220884774. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 16 08:53:59 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b410b256-f6dc-4588-b70a-e3da3b028aee]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:53:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:59 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Jun 16 08:53:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e" returned: 0 in 0.716s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:53:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:53:59 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD Jun 16 08:53:59 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:53:59 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e Jun 16 08:53:59 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:00 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD" returned: 0 in 0.698s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:00 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f77cb0a-aba3-4c26-ac93-d9475e93463e" returned: 0 in 0.630s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-quobyte-3f77cb0a-aba3-4c26-ac93-d9475e93463e" released by "delete_volume" :: held 1.408s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] Created reservations ['9e168557-c7f5-45b0-b4c1-775a184af1cf', '56c7e011-7026-49fe-8284-4e2670449dac', '7a58c1e1-e67e-4a1f-87fd-7fe6ed7d2744', '3978c4cd-0b29-410e-9457-1af67dc6e13c'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:54:00 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD Jun 16 08:54:00 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:00 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:54:00 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:00 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD" returned: 1 in 0.669s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd93cc2-8b92-4287-b2e4-4808ad2b82dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef464e58856f4dceb335413b03daa141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:53:57Z,use_quota=True,user_id='c9e1a217d3db4831b274226220884774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efab8375-3d3f-4cb4-8521-fd47512dd89f),volume_type_id=efab8375-3d3f-4cb4-8521-fd47512dd89f)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Creating volume cbd93cc2-8b92-4287-b2e4-4808ad2b82dd {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:54:00 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:00 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd 1073741824 Jun 16 08:54:00 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:00 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.600s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:54:00 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] Deleted volume successfully. Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b792bc3-fd77-4196-abd1-eb1fc99f49a0 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-3f77cb0a-aba3-4c26-ac93-d9475e93463e-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:54:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] Acquiring lock "cinder-330d5458-65a3-46aa-963a-30f6e1f7a50c-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:54:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-330d5458-65a3-46aa-963a-30f6e1f7a50c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:54:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] Acquiring lock "cinder-quobyte-330d5458-65a3-46aa-963a-30f6e1f7a50c" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:54:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-quobyte-330d5458-65a3-46aa-963a-30f6e1f7a50c" acquired by "delete_volume" :: waited 0.020s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:54:01 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eba52d-c9c8-4e19-b254-cfe54759e6bb]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:54:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-330d5458-65a3-46aa-963a-30f6e1f7a50c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:01 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-330d5458-65a3-46aa-963a-30f6e1f7a50c Jun 16 08:54:01 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:01 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd 1073741824" returned: 0 in 0.899s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:01 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd Jun 16 08:54:01 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:01 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-330d5458-65a3-46aa-963a-30f6e1f7a50c" returned: 0 in 0.760s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-330d5458-65a3-46aa-963a-30f6e1f7a50c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:01 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-330d5458-65a3-46aa-963a-30f6e1f7a50c Jun 16 08:54:01 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:02 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd" returned: 0 in 0.654s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:54:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:02 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Attempting download of fb5b0974-f2b0-448b-b25d-103b6e2b83d2 ((None, [{'url': 'file:///opt/stack/data/glance/images/fb5b0974-f2b0-448b-b25d-103b6e2b83d2', 'metadata': {}}])) to volume cbd93cc2-8b92-4287-b2e4-4808ad2b82dd. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 16 08:54:02 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b178b052-1b3e-4143-bf12-450d227d99bc]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:54:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_ti_ej2ip {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:02 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-330d5458-65a3-46aa-963a-30f6e1f7a50c" returned: 0 in 0.748s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-quobyte-330d5458-65a3-46aa-963a-30f6e1f7a50c" released by "delete_volume" :: held 1.563s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:54:02 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_ti_ej2ip Jun 16 08:54:02 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:02 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] Created reservations ['4f37d697-e74e-4895-8ce0-a0c6252d177b', '70a367f9-e2b4-4cdd-8259-dfa4e0e6930d', 'fa1fc196-a9ed-43ab-95e1-e0fb42ede92a', 'e5d5bda2-ed08-479b-9e89-6e21f685254d'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:54:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:54:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:54:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:02 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:54:02 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:03 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_ti_ej2ip" returned: 0 in 0.784s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_ti_ej2ip {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:03 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_ti_ej2ip Jun 16 08:54:03 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:03 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.763s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:03 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:54:03 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] Deleted volume successfully. Jun 16 08:54:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8f2fa4af-1e71-4493-be11-2982d2bdc917 tempest-VolumeDependencyTests-1155987697 None] Lock "cinder-330d5458-65a3-46aa-963a-30f6e1f7a50c-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:54:04 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_ti_ej2ip" returned: 1 in 0.782s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_ti_ej2ip' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:54:04 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[05431902-eef6-437f-a68a-79b82c78d8e4]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:54:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:04 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD Jun 16 08:54:04 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:04 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD" returned: 0 in 0.820s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:05 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD Jun 16 08:54:05 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:05 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=42,cinder:UPDATE=46,cinder:INSERT=12,cinder:DELETE=2 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:54:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-51542320-df8a-4a9f-9e08-baca9d8af845 req-00cbd2b9-6dff-4d54-af0a-fedfbba7c80b tempest-TestStampPattern-772327495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-51542320-df8a-4a9f-9e08-baca9d8af845 req-00cbd2b9-6dff-4d54-af0a-fedfbba7c80b tempest-TestStampPattern-772327495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:05 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec0c611-c986-40ca-8fb1-a007d15fd3e7]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:54:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-51542320-df8a-4a9f-9e08-baca9d8af845 req-00cbd2b9-6dff-4d54-af0a-fedfbba7c80b tempest-TestStampPattern-772327495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:05 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee Jun 16 08:54:05 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:05 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD" returned: 1 in 1.045s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:54:05 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] fb5b0974-f2b0-448b-b25d-103b6e2b83d2 was raw, converting to raw {{(pid=92348) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 16 08:54:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:06 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd Jun 16 08:54:06 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:06 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-51542320-df8a-4a9f-9e08-baca9d8af845 req-00cbd2b9-6dff-4d54-af0a-fedfbba7c80b tempest-TestStampPattern-772327495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee" returned: 0 in 0.904s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-51542320-df8a-4a9f-9e08-baca9d8af845 req-00cbd2b9-6dff-4d54-af0a-fedfbba7c80b tempest-TestStampPattern-772327495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.944s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-51542320-df8a-4a9f-9e08-baca9d8af845 req-00cbd2b9-6dff-4d54-af0a-fedfbba7c80b tempest-TestStampPattern-772327495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ae0fb82-54fc-40e8-acb1-753f090560a6', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:54:06 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-51542320-df8a-4a9f-9e08-baca9d8af845 req-00cbd2b9-6dff-4d54-af0a-fedfbba7c80b tempest-TestStampPattern-772327495 None] attachment_update completed successfully. Jun 16 08:54:06 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd" returned: 0 in 0.941s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:06 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fb5b0974-f2b0-448b-b25d-103b6e2b83d2_q_98myatdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:54:06 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Converted 0.00 MB image at 0.00 MB/s Jun 16 08:54:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:06 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd 1G Jun 16 08:54:06 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Flow 'volume_create_manager' (af258ddd-8108-4620-98ab-3def6ddf37a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4320fa5c-eb1e-4308-a847-a0e6ae854fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4320fa5c-eb1e-4308-a847-a0e6ae854fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c898dad6-9573-4ac0-9976-7f6567b6c1ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e19d25c6b8c4a5991dd9453cd9398a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:54:07Z,use_quota=True,user_id='3e786e4151014d919e30ad700539f699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e684319-cfb7-4513-9618-d66392734d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e684319-cfb7-4513-9618-d66392734d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a993164a-4dd6-4f27-8647-92c6f84f0380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a993164a-4dd6-4f27-8647-92c6f84f0380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c898dad6-9573-4ac0-9976-7f6567b6c1ec', 'volume_name': 'volume-c898dad6-9573-4ac0-9976-7f6567b6c1ec', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a342ac75-3200-4c07-bffd-801f07b67af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a342ac75-3200-4c07-bffd-801f07b67af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f070150-3fe4-490e-9584-4d9652cc0224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:07 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Volume c898dad6-9573-4ac0-9976-7f6567b6c1ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c898dad6-9573-4ac0-9976-7f6567b6c1ec', 'volume_size': 1} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c898dad6-9573-4ac0-9976-7f6567b6c1ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e19d25c6b8c4a5991dd9453cd9398a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:54:07Z,use_quota=True,user_id='3e786e4151014d919e30ad700539f699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Creating volume c898dad6-9573-4ac0-9976-7f6567b6c1ec {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:54:07 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c898dad6-9573-4ac0-9976-7f6567b6c1ec 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:07 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c898dad6-9573-4ac0-9976-7f6567b6c1ec 1073741824 Jun 16 08:54:07 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:07 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd 1G" returned: 0 in 0.766s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4b546f-b2e6-4a32-af7a-496455d17760]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:54:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:07 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd Jun 16 08:54:07 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:08 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c898dad6-9573-4ac0-9976-7f6567b6c1ec 1073741824" returned: 0 in 0.970s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c898dad6-9573-4ac0-9976-7f6567b6c1ec {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:08 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c898dad6-9573-4ac0-9976-7f6567b6c1ec Jun 16 08:54:08 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:08 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd" returned: 0 in 0.800s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:08 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd Jun 16 08:54:08 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:08 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c898dad6-9573-4ac0-9976-7f6567b6c1ec" returned: 0 in 0.669s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:08 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:54:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f070150-3fe4-490e-9584-4d9652cc0224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c898dad6-9573-4ac0-9976-7f6567b6c1ec', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0b95f2-66af-4e0d-8dbe-ccc7b8433e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:09 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Volume volume-c898dad6-9573-4ac0-9976-7f6567b6c1ec (c898dad6-9573-4ac0-9976-7f6567b6c1ec): created successfully Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0b95f2-66af-4e0d-8dbe-ccc7b8433e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Flow 'volume_create_manager' (af258ddd-8108-4620-98ab-3def6ddf37a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:54:09 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-819913ca-7ab1-4991-857e-1042715317f3 tempest-CinderUnicodeTest-672941376 None] Created volume successfully. Jun 16 08:54:09 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd" returned: 1 in 0.722s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Downloaded image fb5b0974-f2b0-448b-b25d-103b6e2b83d2 ((None, [{'url': 'file:///opt/stack/data/glance/images/fb5b0974-f2b0-448b-b25d-103b6e2b83d2', 'metadata': {}}])) to volume cbd93cc2-8b92-4287-b2e4-4808ad2b82dd successfully. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Temporary image fb5b0974-f2b0-448b-b25d-103b6e2b83d2 for user c9e1a217d3db4831b274226220884774 is deleted. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Marking volume cbd93cc2-8b92-4287-b2e4-4808ad2b82dd as bootable. {{(pid=92348) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Copying metadata from image fb5b0974-f2b0-448b-b25d-103b6e2b83d2 to cbd93cc2-8b92-4287-b2e4-4808ad2b82dd. {{(pid=92348) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Creating volume glance metadata for volume cbd93cc2-8b92-4287-b2e4-4808ad2b82dd backed by image fb5b0974-f2b0-448b-b25d-103b6e2b83d2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fb5b0974-f2b0-448b-b25d-103b6e2b83d2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ff663255e7e1852e95e8d941f0ef2c9e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92348) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8f50cc-bec7-4910-a24d-1ad3ef69d4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd', 'volume_size': 1, 'image_id': 'fb5b0974-f2b0-448b-b25d-103b6e2b83d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb5b0974-f2b0-448b-b25d-103b6e2b83d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff663255e7e1852e95e8d941f0ef2c9e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef464e58856f4dceb335413b03daa141', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6e279fe7d6c052960d313846f715c54f79b900f43e5c089db9270eb726b2f1b66b1473a8a4ffb1fac5cfee278c7e1e25fd41025b4ad0031f3d3c6950eeca654f', 'id': 'fb5b0974-f2b0-448b-b25d-103b6e2b83d2', 'created_at': datetime.datetime(2026, 6, 16, 6, 53, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 53, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb5b0974-f2b0-448b-b25d-103b6e2b83d2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c588904-6eeb-4816-934a-33c7b0b4b680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:09 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Volume volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd (cbd93cc2-8b92-4287-b2e4-4808ad2b82dd): created successfully Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c588904-6eeb-4816-934a-33c7b0b4b680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Flow 'volume_create_manager' (7eedea24-75ba-4592-a738-6f309bc2b43c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:54:09 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-243a9eba-8e5b-4ec3-b0e3-e11cc3e2b850 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Created volume successfully. Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Flow 'volume_create_manager' (d93f3c35-505f-4967-a8a0-5ae7020565cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033f5d5d-dd9c-4db3-8f97-92fcaa67c87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=54,cinder:INSERT=17,cinder:UPDATE=61,cinder:DELETE=6 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033f5d5d-dd9c-4db3-8f97-92fcaa67c87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:54:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1284052175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0038ed9a-a432-4da4-b889-734318e97eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e19d25c6b8c4a5991dd9453cd9398a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:54:10Z,use_quota=True,user_id='3e786e4151014d919e30ad700539f699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5a5b17-49e1-49ea-bd2f-2fa413c4fa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5a5b17-49e1-49ea-bd2f-2fa413c4fa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4fbb56-22fc-4fa2-84f9-36cf782f3e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4fbb56-22fc-4fa2-84f9-36cf782f3e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0038ed9a-a432-4da4-b889-734318e97eef', 'volume_name': 'volume-0038ed9a-a432-4da4-b889-734318e97eef', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2051a8cc-df12-4fb8-a284-c0c8769b0ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2051a8cc-df12-4fb8-a284-c0c8769b0ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8184b64-98af-44ce-94bd-a2e4d35f1956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:09 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Volume 0038ed9a-a432-4da4-b889-734318e97eef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0038ed9a-a432-4da4-b889-734318e97eef', 'volume_size': 1} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:54:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1284052175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0038ed9a-a432-4da4-b889-734318e97eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e19d25c6b8c4a5991dd9453cd9398a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:54:10Z,use_quota=True,user_id='3e786e4151014d919e30ad700539f699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Creating volume 0038ed9a-a432-4da4-b889-734318e97eef {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:54:09 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:54:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:09 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef 1073741824 Jun 16 08:54:09 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:10 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Acquiring lock "cinder-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:54:10 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Lock "cinder-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:54:10 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Acquiring lock "cinder-quobyte-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:54:10 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Lock "cinder-quobyte-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd" acquired by "delete_volume" :: waited 0.013s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:54:10 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfe78ba-0c54-4628-9500-7a87cd85fe1c]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:54:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:10 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd Jun 16 08:54:10 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:10 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef 1073741824" returned: 0 in 0.814s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:10 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef Jun 16 08:54:10 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:11 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd" returned: 0 in 0.747s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:11 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd Jun 16 08:54:11 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:11 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef" returned: 0 in 0.625s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:11 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:54:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8184b64-98af-44ce-94bd-a2e4d35f1956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0038ed9a-a432-4da4-b889-734318e97eef', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6e2df0-3673-4e12-b84c-d4a28dace1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:11 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Volume volume-0038ed9a-a432-4da4-b889-734318e97eef (0038ed9a-a432-4da4-b889-734318e97eef): created successfully Jun 16 08:54:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6e2df0-3673-4e12-b84c-d4a28dace1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Flow 'volume_create_manager' (d93f3c35-505f-4967-a8a0-5ae7020565cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:54:11 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-6e734b2d-a394-4130-afa2-620ada568757 tempest-CinderUnicodeTest-672941376 None] Created volume successfully. Jun 16 08:54:11 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd" returned: 1 in 0.729s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:54:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:11 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd Jun 16 08:54:11 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] Creating offline snapshot 6159f034-cc8f-45f3-8063-496ae5665b9f of volume 0038ed9a-a432-4da4-b889-734318e97eef {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:54:12 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc852c2-899f-48ba-9d10-92c9066fb655]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:54:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:12 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef Jun 16 08:54:12 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:12 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd" returned: 0 in 0.760s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Lock "cinder-quobyte-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd" released by "delete_volume" :: held 2.314s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:54:12 devstack cinder-volume[92348]: WARNING cinder.quota [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:54:12 devstack cinder-volume[92348]: WARNING cinder.quota [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:54:12 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Created reservations ['5890f11a-7c80-44b9-9fb6-65f9cc191526', 'bbfc8cb4-d253-4048-ae1f-f61313486a8e', '99512895-88d6-45e7-b53c-6cd134dfafd2', '02abb842-dcee-4c4a-ab69-4699c95c9aae'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:54:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:54:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:54:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:12 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:54:12 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:13 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef" returned: 0 in 0.868s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:13 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f 1G Jun 16 08:54:13 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:13 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.038s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:13 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:54:13 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Deleted volume successfully. Jun 16 08:54:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ad5aa212-1db1-467b-abdc-222a5c3550d4 tempest-VolumeAndVolumeTypeFromImageTest-705950800 None] Lock "cinder-cbd93cc2-8b92-4287-b2e4-4808ad2b82dd-delete_volume" released by "delete_volume" :: held 3.640s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:54:14 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f 1G" returned: 0 in 1.073s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0038ed9a-a432-4da4-b889-734318e97eef -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:14 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0038ed9a-a432-4da4-b889-734318e97eef -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f Jun 16 08:54:14 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:15 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0038ed9a-a432-4da4-b889-734318e97eef -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f" returned: 0 in 0.956s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:15 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f is being set with open permissions: ugo+rw Jun 16 08:54:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:15 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f Jun 16 08:54:15 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:15 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f" returned: 0 in 0.722s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:16 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.info Jun 16 08:54:16 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:16 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-9618033c-f3c2-455e-ba04-a76b6c3e9e2e req-63eaa832-b70f-44ca-9f9f-4a6a153895e1 tempest-TestStampPattern-772327495 None] Terminate volume connection completed successfully. Jun 16 08:54:16 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-9618033c-f3c2-455e-ba04-a76b6c3e9e2e req-63eaa832-b70f-44ca-9f9f-4a6a153895e1 tempest-TestStampPattern-772327495 None] Deleting attachment 6ae0fb82-54fc-40e8-acb1-753f090560a6. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:54:16 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.info" returned: 0 in 0.666s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:16 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.info is being set with open permissions: ugo+rw Jun 16 08:54:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:16 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.info Jun 16 08:54:16 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:17 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.info" returned: 0 in 0.602s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.018s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:17 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-e3fe2885-0d23-4555-88ff-4a8106201167 tempest-CinderUnicodeTest-672941376 None] Create snapshot completed successfully Jun 16 08:54:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] Acquiring lock "cinder-6159f034-cc8f-45f3-8063-496ae5665b9f-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:54:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] Lock "cinder-6159f034-cc8f-45f3-8063-496ae5665b9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:54:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] Acquiring lock "cinder-quobyte-0038ed9a-a432-4da4-b889-734318e97eef" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:54:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] Lock "cinder-quobyte-0038ed9a-a432-4da4-b889-734318e97eef" acquired by "delete_snapshot" :: waited 0.014s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:54:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] Acquiring lock "cinder-quobyte-6159f034-cc8f-45f3-8063-496ae5665b9f" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:54:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] Lock "cinder-quobyte-6159f034-cc8f-45f3-8063-496ae5665b9f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:54:17 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] Deleting offline snapshot 6159f034-cc8f-45f3-8063-496ae5665b9f of volume 0038ed9a-a432-4da4-b889-734318e97eef {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:54:17 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] snapshot_file for this snap is: volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:54:17 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6e3f29-698a-451d-931b-953815f7cd34]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:54:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:17 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f Jun 16 08:54:17 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:18 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] Creating offline snapshot 797cf2e0-b27e-45e3-96b5-9e363e0f0aff of volume 2158fb41-53fa-40c4-aa9a-8eab903c44ee {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:54:18 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f063876-8d23-43b9-94ac-44119204ab1c]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:54:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:18 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee Jun 16 08:54:18 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f" returned: 0 in 0.729s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:18 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0038ed9a-a432-4da4-b889-734318e97eef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:54:18 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:18 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0047e0-bb5e-48ce-a536-f913ce4a5eb7]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:54:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:18 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef Jun 16 08:54:18 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:18 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee" returned: 0 in 0.763s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:19 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff 1G Jun 16 08:54:19 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:19 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef" returned: 0 in 0.742s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:19 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f Jun 16 08:54:19 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:19 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff 1G" returned: 0 in 0.768s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:19 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff Jun 16 08:54:19 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:19 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f" returned: 0 in 0.708s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:19 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f Jun 16 08:54:19 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:20 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef.6159f034-cc8f-45f3-8063-496ae5665b9f" returned: 0 in 1.059s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:20 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff" returned: 0 in 1.225s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:20 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff is being set with open permissions: ugo+rw Jun 16 08:54:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:21 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] Lock "cinder-quobyte-6159f034-cc8f-45f3-8063-496ae5665b9f" released by "_delete_snapshot" :: held 3.421s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:54:21 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] Lock "cinder-quobyte-0038ed9a-a432-4da4-b889-734318e97eef" released by "delete_snapshot" :: held 3.450s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:54:21 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff Jun 16 08:54:21 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:21 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] Created reservations ['705d810f-0e54-41ec-b9c4-84f6715603a9', 'cd110739-e705-4620-a107-364968faeca6', '9e97a84d-e462-4215-9398-9f127f1f1eac', 'f9b2ecfe-2d3e-484a-8fc6-a2bb2196b90b'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:54:21 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] Delete snapshot completed successfully. Jun 16 08:54:21 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8b7a4250-0ce3-457a-9e74-e9055c6075b1 tempest-CinderUnicodeTest-672941376 None] Lock "cinder-6159f034-cc8f-45f3-8063-496ae5665b9f-delete_snapshot" released by "delete_snapshot" :: held 3.685s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:54:21 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff" returned: 0 in 0.698s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:21 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.info Jun 16 08:54:21 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:21 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] Acquiring lock "cinder-0038ed9a-a432-4da4-b889-734318e97eef-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:54:21 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] Lock "cinder-0038ed9a-a432-4da4-b889-734318e97eef-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:54:21 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] Acquiring lock "cinder-quobyte-0038ed9a-a432-4da4-b889-734318e97eef" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:54:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] Lock "cinder-quobyte-0038ed9a-a432-4da4-b889-734318e97eef" acquired by "delete_volume" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:54:22 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1a812a-a2a5-4c7e-8a13-32600ba70c63]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:54:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:22 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef Jun 16 08:54:22 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:22 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.info" returned: 0 in 0.735s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:22 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.info is being set with open permissions: ugo+rw Jun 16 08:54:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:22 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.info Jun 16 08:54:22 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:22 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef" returned: 0 in 0.886s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:23 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef Jun 16 08:54:23 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:23 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.info" returned: 0 in 0.714s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.996s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:23 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-0a3db08d-8435-40a3-8e24-240905d6cd47 tempest-TestStampPattern-772327495 None] Create snapshot completed successfully Jun 16 08:54:23 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0038ed9a-a432-4da4-b889-734318e97eef" returned: 0 in 0.690s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:23 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] Lock "cinder-quobyte-0038ed9a-a432-4da4-b889-734318e97eef" released by "delete_volume" :: held 1.693s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:54:23 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] Created reservations ['ec8b9215-11df-45c2-92fb-6b599095b728', '8321dd31-57aa-4be9-a945-532c5584f1c8', 'f01d328d-fe9c-4473-863f-05824c5118a6', '9205d5de-3635-462e-be8b-9ea3b0d3804a'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:54:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:54:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:54:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:23 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:54:23 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:24 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] Acquiring lock "cinder-c898dad6-9573-4ac0-9976-7f6567b6c1ec-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:54:24 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] Lock "cinder-c898dad6-9573-4ac0-9976-7f6567b6c1ec-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:54:24 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] Acquiring lock "cinder-quobyte-c898dad6-9573-4ac0-9976-7f6567b6c1ec" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:54:24 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] Lock "cinder-quobyte-c898dad6-9573-4ac0-9976-7f6567b6c1ec" acquired by "delete_volume" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:54:24 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1549e13-03f3-4182-954b-a91e6176de61]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:54:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c898dad6-9573-4ac0-9976-7f6567b6c1ec {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:24 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c898dad6-9573-4ac0-9976-7f6567b6c1ec Jun 16 08:54:24 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:24 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.080s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:24 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:54:24 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] Deleted volume successfully. Jun 16 08:54:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1e5c211e-4f19-41a6-8fe7-5b8b8f907792 tempest-CinderUnicodeTest-672941376 None] Lock "cinder-0038ed9a-a432-4da4-b889-734318e97eef-delete_volume" released by "delete_volume" :: held 3.085s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:54:25 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c898dad6-9573-4ac0-9976-7f6567b6c1ec" returned: 0 in 0.881s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c898dad6-9573-4ac0-9976-7f6567b6c1ec {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:25 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c898dad6-9573-4ac0-9976-7f6567b6c1ec Jun 16 08:54:25 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:26 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c898dad6-9573-4ac0-9976-7f6567b6c1ec" returned: 0 in 0.689s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] Lock "cinder-quobyte-c898dad6-9573-4ac0-9976-7f6567b6c1ec" released by "delete_volume" :: held 1.641s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:54:26 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] Created reservations ['5cdee390-cab0-418f-a652-a3f68c2a01e9', 'b6724117-3086-4ba4-aed5-70c9dddc8457', '65a7166c-dede-419b-a482-c6063d427cf6', '1c967972-a3c8-4a73-b76c-f1631db16a16'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:54:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:54:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:54:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:26 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:54:26 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:26 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.685s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:26 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:54:26 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] Deleted volume successfully. Jun 16 08:54:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d9fc1d91-6aa7-46be-ba7f-f0ed5654674c tempest-CinderUnicodeTest-672941376 None] Lock "cinder-c898dad6-9573-4ac0-9976-7f6567b6c1ec-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:54:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:54:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:54:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:54:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:30 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:54:30 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:30 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.615s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:30 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:54:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:54:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:54:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Flow 'volume_create_manager' (30dc002b-4ad1-4efe-bfb4-4cae491b34aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a79993-241b-4e1f-a75d-42711a217416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a79993-241b-4e1f-a75d-42711a217416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1969365625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37500a18-d37c-46f7-913f-db47514bb5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df011d3426044334bc342df2740ba4c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=797cf2e0-b27e-45e3-96b5-9e363e0f0aff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:54:34Z,use_quota=True,user_id='2ac379b3791a4836970c1027d0a0f76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e02d630-d138-4111-9344-c0b8d896726c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e02d630-d138-4111-9344-c0b8d896726c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2303415-7e4d-4eb9-8851-e5956e560ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2303415-7e4d-4eb9-8851-e5956e560ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '37500a18-d37c-46f7-913f-db47514bb5db', 'volume_name': 'volume-37500a18-d37c-46f7-913f-db47514bb5db', 'volume_size': 1, 'snapshot_id': '797cf2e0-b27e-45e3-96b5-9e363e0f0aff'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89283e1-beda-4ef4-aa75-6d8386880791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89283e1-beda-4ef4-aa75-6d8386880791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db7a537-575f-408c-934a-c0863e993bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:33 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Volume 37500a18-d37c-46f7-913f-db47514bb5db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-37500a18-d37c-46f7-913f-db47514bb5db', 'volume_size': 1, 'snapshot_id': '797cf2e0-b27e-45e3-96b5-9e363e0f0aff'} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Acquiring lock "cinder-quobyte-797cf2e0-b27e-45e3-96b5-9e363e0f0aff-37500a18-d37c-46f7-913f-db47514bb5db" by "_create_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Lock "cinder-quobyte-797cf2e0-b27e-45e3-96b5-9e363e0f0aff-37500a18-d37c-46f7-913f-db47514bb5db" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Creating volume 37500a18-d37c-46f7-913f-db47514bb5db from snapshot 797cf2e0-b27e-45e3-96b5-9e363e0f0aff {{(pid=92348) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Acquiring lock "cinder-quobyte-37500a18-d37c-46f7-913f-db47514bb5db" by "_copy_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Lock "cinder-quobyte-37500a18-d37c-46f7-913f-db47514bb5db" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] snapshot: 797cf2e0-b27e-45e3-96b5-9e363e0f0aff, volume: 37500a18-d37c-46f7-913f-db47514bb5db, {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d43749-9176-4817-a03f-729cbdaa697d]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:54:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:33 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff Jun 16 08:54:33 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:34 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff" returned: 0 in 0.766s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:54:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 16 08:54:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Creating direct copy from snapshot {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 16 08:54:34 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7528783-9db2-486d-a628-e68bb0de1558]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:54:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:34 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee Jun 16 08:54:34 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:35 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee" returned: 0 in 0.696s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:35 devstack cinder-volume[92348]: DEBUG cinder.utils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Path /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db not found in is_blk_device check {{(pid=92348) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 16 08:54:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:35 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db Jun 16 08:54:35 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:40 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db" returned: 0 in 4.819s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:40 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25160d9-77a2-49f1-b2bc-82905f80c8e2]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:54:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:40 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee Jun 16 08:54:40 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:41 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee" returned: 0 in 1.238s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:41 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee, size 1024.00 MB, duration 4.82 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:54:41 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Converted 1024.00 MB image at 212.43 MB/s Jun 16 08:54:41 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db is being set with open permissions: ugo+rw Jun 16 08:54:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:41 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db Jun 16 08:54:41 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:42 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db" returned: 0 in 0.898s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:42 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Lock "cinder-quobyte-37500a18-d37c-46f7-913f-db47514bb5db" released by "_copy_volume_from_snapshot" :: held 8.521s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:54:42 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Lock "cinder-quobyte-797cf2e0-b27e-45e3-96b5-9e363e0f0aff-37500a18-d37c-46f7-913f-db47514bb5db" released by "_create_volume_from_snapshot" :: held 8.555s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:54:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.570s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db7a537-575f-408c-934a-c0863e993bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37500a18-d37c-46f7-913f-db47514bb5db', 'volume_size': 1, 'snapshot_id': '797cf2e0-b27e-45e3-96b5-9e363e0f0aff'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4faba079-afe8-4776-89e7-8f3925157774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:42 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Volume volume-37500a18-d37c-46f7-913f-db47514bb5db (37500a18-d37c-46f7-913f-db47514bb5db): created successfully Jun 16 08:54:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4faba079-afe8-4776-89e7-8f3925157774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Flow 'volume_create_manager' (30dc002b-4ad1-4efe-bfb4-4cae491b34aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:54:42 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-bf3ff26f-2971-4e7b-88c6-6a93df253d34 tempest-TestStampPattern-772327495 None] Created volume successfully. Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Flow 'volume_create_manager' (202462ff-e148-497f-8c6a-8aab81538944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e771179f-feb3-4c15-835a-00a320605d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e771179f-feb3-4c15-835a-00a320605d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2019774498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be102f9-9d39-43e9-8e0d-462ccd862aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3a28b928ea44198b889318381baa1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:54:46Z,use_quota=True,user_id='d08d34b98eac4df199376dddad734b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc3333e-87a6-4115-ab74-c5b0906d59ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc3333e-87a6-4115-ab74-c5b0906d59ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccdfef3-b002-4527-aedf-3da86aad7815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccdfef3-b002-4527-aedf-3da86aad7815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8be102f9-9d39-43e9-8e0d-462ccd862aff', 'volume_name': 'volume-8be102f9-9d39-43e9-8e0d-462ccd862aff', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d71b8f-e794-4a93-8238-d07b5be37d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d71b8f-e794-4a93-8238-d07b5be37d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be132b01-aa4c-45a6-81d4-42befcc1083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:46 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Volume 8be102f9-9d39-43e9-8e0d-462ccd862aff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8be102f9-9d39-43e9-8e0d-462ccd862aff', 'volume_size': 1} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2019774498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be102f9-9d39-43e9-8e0d-462ccd862aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3a28b928ea44198b889318381baa1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:54:46Z,use_quota=True,user_id='d08d34b98eac4df199376dddad734b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Creating volume 8be102f9-9d39-43e9-8e0d-462ccd862aff {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:54:46 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:54:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8be102f9-9d39-43e9-8e0d-462ccd862aff 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:46 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8be102f9-9d39-43e9-8e0d-462ccd862aff 1073741824 Jun 16 08:54:46 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:47 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8be102f9-9d39-43e9-8e0d-462ccd862aff 1073741824" returned: 0 in 0.808s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8be102f9-9d39-43e9-8e0d-462ccd862aff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:47 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8be102f9-9d39-43e9-8e0d-462ccd862aff Jun 16 08:54:47 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:47 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8be102f9-9d39-43e9-8e0d-462ccd862aff" returned: 0 in 0.711s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:54:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be132b01-aa4c-45a6-81d4-42befcc1083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8be102f9-9d39-43e9-8e0d-462ccd862aff', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c8519e-edbf-4796-8676-1f29c3a120e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:54:47 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Volume volume-8be102f9-9d39-43e9-8e0d-462ccd862aff (8be102f9-9d39-43e9-8e0d-462ccd862aff): created successfully Jun 16 08:54:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c8519e-edbf-4796-8676-1f29c3a120e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:54:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Flow 'volume_create_manager' (202462ff-e148-497f-8c6a-8aab81538944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:54:47 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-d6c46309-198e-4774-ba04-2bd939b767fb tempest-AttachVolumeNegativeTest-838816842 None] Created volume successfully. Jun 16 08:54:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-191551e5-5925-487d-bd95-cc855d92d16d req-b3ca08b0-3672-4a1c-bd14-c990833ab8bd tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:54:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-191551e5-5925-487d-bd95-cc855d92d16d req-b3ca08b0-3672-4a1c-bd14-c990833ab8bd tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:54:52 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0be0132-497c-417c-825b-8dfa8a8f4838]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:54:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-191551e5-5925-487d-bd95-cc855d92d16d req-b3ca08b0-3672-4a1c-bd14-c990833ab8bd tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8be102f9-9d39-43e9-8e0d-462ccd862aff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:54:52 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8be102f9-9d39-43e9-8e0d-462ccd862aff Jun 16 08:54:52 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:54:52 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jun 16 08:54:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-191551e5-5925-487d-bd95-cc855d92d16d req-b3ca08b0-3672-4a1c-bd14-c990833ab8bd tempest-AttachVolumeNegativeTest-838816842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8be102f9-9d39-43e9-8e0d-462ccd862aff" returned: 0 in 0.838s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:54:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-191551e5-5925-487d-bd95-cc855d92d16d req-b3ca08b0-3672-4a1c-bd14-c990833ab8bd tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.855s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:54:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-191551e5-5925-487d-bd95-cc855d92d16d req-b3ca08b0-3672-4a1c-bd14-c990833ab8bd tempest-AttachVolumeNegativeTest-838816842 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-8be102f9-9d39-43e9-8e0d-462ccd862aff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b532e61-72aa-4c64-84dc-485aa2c52a4b', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:54:53 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-191551e5-5925-487d-bd95-cc855d92d16d req-b3ca08b0-3672-4a1c-bd14-c990833ab8bd tempest-AttachVolumeNegativeTest-838816842 None] attachment_update completed successfully. Jun 16 08:54:59 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-044ffce5-cdd0-4468-82e1-cafbd909840c req-562856f5-a18c-4b27-91cf-bf2b18ad2440 tempest-AttachVolumeNegativeTest-838816842 None] Terminate volume connection completed successfully. Jun 16 08:54:59 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-044ffce5-cdd0-4468-82e1-cafbd909840c req-562856f5-a18c-4b27-91cf-bf2b18ad2440 tempest-AttachVolumeNegativeTest-838816842 None] Deleting attachment 4b532e61-72aa-4c64-84dc-485aa2c52a4b. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:55:03 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=57,cinder:UPDATE=49,cinder:INSERT=17,cinder:DELETE=4 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:55:09 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:UPDATE=41,cinder:SELECT=38,cinder:DELETE=6,cinder:INSERT=9 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:55:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-4aad4920-8335-4c40-a576-dbf43af76013 req-5f824d99-1124-42cc-9d4d-989410fac8cd tempest-TestStampPattern-772327495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:55:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-4aad4920-8335-4c40-a576-dbf43af76013 req-5f824d99-1124-42cc-9d4d-989410fac8cd tempest-TestStampPattern-772327495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:55:18 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb31144-86ca-429f-92f7-391e2de5c283]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:55:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-4aad4920-8335-4c40-a576-dbf43af76013 req-5f824d99-1124-42cc-9d4d-989410fac8cd tempest-TestStampPattern-772327495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:55:18 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db Jun 16 08:55:18 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:55:19 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jun 16 08:55:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-4aad4920-8335-4c40-a576-dbf43af76013 req-5f824d99-1124-42cc-9d4d-989410fac8cd tempest-TestStampPattern-772327495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db" returned: 0 in 0.777s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:55:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-4aad4920-8335-4c40-a576-dbf43af76013 req-5f824d99-1124-42cc-9d4d-989410fac8cd tempest-TestStampPattern-772327495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.807s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:55:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-4aad4920-8335-4c40-a576-dbf43af76013 req-5f824d99-1124-42cc-9d4d-989410fac8cd tempest-TestStampPattern-772327495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-37500a18-d37c-46f7-913f-db47514bb5db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17a2718e-9737-496b-b502-54ce972b2597', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:55:19 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-4aad4920-8335-4c40-a576-dbf43af76013 req-5f824d99-1124-42cc-9d4d-989410fac8cd tempest-TestStampPattern-772327495 None] attachment_update completed successfully. Jun 16 08:55:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-69f5b1ce-295d-4d85-af9c-3c33abad9416 req-84eae26a-6e6b-41e5-a97a-012afbec6672 tempest-TestStampPattern-772327495 None] Terminate volume connection completed successfully. Jun 16 08:55:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-69f5b1ce-295d-4d85-af9c-3c33abad9416 req-84eae26a-6e6b-41e5-a97a-012afbec6672 tempest-TestStampPattern-772327495 None] Deleting attachment 17a2718e-9737-496b-b502-54ce972b2597. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:55:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:55:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:55:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:55:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:55:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:55:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:55:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:55:30 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:55:30 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:55:30 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Jun 16 08:55:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.678s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:55:30 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:55:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:55:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:55:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:55:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] Acquiring lock "cinder-37500a18-d37c-46f7-913f-db47514bb5db-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:55:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] Lock "cinder-37500a18-d37c-46f7-913f-db47514bb5db-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:55:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] Acquiring lock "cinder-quobyte-37500a18-d37c-46f7-913f-db47514bb5db" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:55:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] Lock "cinder-quobyte-37500a18-d37c-46f7-913f-db47514bb5db" acquired by "delete_volume" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:55:37 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[773f141f-9adf-4dce-946b-342e81b83527]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:55:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:55:37 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db Jun 16 08:55:37 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:55:38 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Jun 16 08:55:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db" returned: 0 in 0.695s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:55:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:55:38 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db Jun 16 08:55:38 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:55:38 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Jun 16 08:55:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-37500a18-d37c-46f7-913f-db47514bb5db" returned: 0 in 0.594s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:55:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] Lock "cinder-quobyte-37500a18-d37c-46f7-913f-db47514bb5db" released by "delete_volume" :: held 1.339s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:55:38 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] Created reservations ['6ca46393-0fae-4729-89cf-f08dc832d268', '4720e719-9b6d-4791-8610-a067bd6be066', '31d7bffb-0e8b-49a3-9ef7-142a2aff0b03', 'eadc08eb-6834-467e-aa8b-bcfb5df68d8d'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:55:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:55:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:55:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:55:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:55:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:55:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:55:39 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:55:39 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:55:39 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Jun 16 08:55:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.581s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:55:39 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:55:39 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] Deleted volume successfully. Jun 16 08:55:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3fa5942d-b6e0-4309-964a-ec844ab5f0cb tempest-TestStampPattern-772327495 None] Lock "cinder-37500a18-d37c-46f7-913f-db47514bb5db-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:55:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] Acquiring lock "cinder-797cf2e0-b27e-45e3-96b5-9e363e0f0aff-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:55:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] Lock "cinder-797cf2e0-b27e-45e3-96b5-9e363e0f0aff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:55:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] Acquiring lock "cinder-quobyte-2158fb41-53fa-40c4-aa9a-8eab903c44ee" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:55:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] Lock "cinder-quobyte-2158fb41-53fa-40c4-aa9a-8eab903c44ee" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:55:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] Acquiring lock "cinder-quobyte-797cf2e0-b27e-45e3-96b5-9e363e0f0aff" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:55:40 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] Lock "cinder-quobyte-797cf2e0-b27e-45e3-96b5-9e363e0f0aff" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:55:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] Deleting offline snapshot 797cf2e0-b27e-45e3-96b5-9e363e0f0aff of volume 2158fb41-53fa-40c4-aa9a-8eab903c44ee {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:55:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] snapshot_file for this snap is: volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:55:40 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ac295e-7497-4e13-9f6d-1f87e4629672]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:55:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:55:40 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff Jun 16 08:55:40 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:55:40 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Jun 16 08:55:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff" returned: 0 in 0.691s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:55:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:55:40 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baf6197-17be-41fc-a32f-1de20c1fb6b5]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:55:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:55:40 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee Jun 16 08:55:40 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:55:41 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Jun 16 08:55:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee" returned: 0 in 0.696s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:55:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:55:41 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff Jun 16 08:55:41 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:55:42 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Jun 16 08:55:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff" returned: 0 in 0.657s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:55:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:55:42 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff Jun 16 08:55:42 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:55:42 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Jun 16 08:55:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee.797cf2e0-b27e-45e3-96b5-9e363e0f0aff" returned: 0 in 0.593s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:55:42 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] Lock "cinder-quobyte-797cf2e0-b27e-45e3-96b5-9e363e0f0aff" released by "_delete_snapshot" :: held 2.730s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:55:42 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] Lock "cinder-quobyte-2158fb41-53fa-40c4-aa9a-8eab903c44ee" released by "delete_snapshot" :: held 2.751s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:55:42 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] Created reservations ['7a9ed004-14e3-4279-a3b1-ea5e8075d6ea', '6f863706-6901-4674-97eb-a63e3f340204', 'fd2ed588-898f-454c-bbbf-f822a7f1fdb2', '4280c488-e100-414c-939f-0202148f180f'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:55:42 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] Delete snapshot completed successfully. Jun 16 08:55:42 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-204caaca-8b0d-43ae-a094-f3c554a7127e tempest-TestStampPattern-772327495 None] Lock "cinder-797cf2e0-b27e-45e3-96b5-9e363e0f0aff-delete_snapshot" released by "delete_snapshot" :: held 2.873s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Flow 'volume_create_manager' (b4bd530d-912b-4f1f-9cf7-93d753615245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9382a1c0-4039-49ad-b30a-2c0a873bc6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9382a1c0-4039-49ad-b30a-2c0a873bc6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-193947074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe48eab-6460-47a9-b15c-a7d904eb4792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3a28b928ea44198b889318381baa1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:55:49Z,use_quota=True,user_id='d08d34b98eac4df199376dddad734b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87dad44b-d3dc-4745-96cc-31502eb29b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87dad44b-d3dc-4745-96cc-31502eb29b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e1ac46-19e7-43ed-a1f4-25b2f244fb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e1ac46-19e7-43ed-a1f4-25b2f244fb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afe48eab-6460-47a9-b15c-a7d904eb4792', 'volume_name': 'volume-afe48eab-6460-47a9-b15c-a7d904eb4792', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12afec4c-f5c2-45b4-8b13-593fa95bc4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12afec4c-f5c2-45b4-8b13-593fa95bc4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6263b40-03ab-4850-b1a1-cf286e980b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:55:49 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Volume afe48eab-6460-47a9-b15c-a7d904eb4792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afe48eab-6460-47a9-b15c-a7d904eb4792', 'volume_size': 1} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-193947074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe48eab-6460-47a9-b15c-a7d904eb4792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3a28b928ea44198b889318381baa1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:55:49Z,use_quota=True,user_id='d08d34b98eac4df199376dddad734b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Creating volume afe48eab-6460-47a9-b15c-a7d904eb4792 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:55:49 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-afe48eab-6460-47a9-b15c-a7d904eb4792 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:55:49 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-afe48eab-6460-47a9-b15c-a7d904eb4792 1073741824 Jun 16 08:55:49 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:55:49 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-afe48eab-6460-47a9-b15c-a7d904eb4792 1073741824" returned: 0 in 0.773s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:55:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-afe48eab-6460-47a9-b15c-a7d904eb4792 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:55:50 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-afe48eab-6460-47a9-b15c-a7d904eb4792 Jun 16 08:55:50 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:55:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] Acquiring lock "cinder-2158fb41-53fa-40c4-aa9a-8eab903c44ee-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:55:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] Lock "cinder-2158fb41-53fa-40c4-aa9a-8eab903c44ee-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:55:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] Acquiring lock "cinder-quobyte-2158fb41-53fa-40c4-aa9a-8eab903c44ee" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:55:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] Lock "cinder-quobyte-2158fb41-53fa-40c4-aa9a-8eab903c44ee" acquired by "delete_volume" :: waited 0.014s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:55:50 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fe01fb-ab95-4eb6-9b16-08e618ec221f]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:55:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:55:50 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Jun 16 08:55:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-afe48eab-6460-47a9-b15c-a7d904eb4792" returned: 0 in 0.602s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:55:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:55:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:55:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6263b40-03ab-4850-b1a1-cf286e980b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe48eab-6460-47a9-b15c-a7d904eb4792', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:55:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd399f1b-d1ce-423e-9bad-32139bf73cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:55:50 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee Jun 16 08:55:50 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:55:50 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Volume volume-afe48eab-6460-47a9-b15c-a7d904eb4792 (afe48eab-6460-47a9-b15c-a7d904eb4792): created successfully Jun 16 08:55:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd399f1b-d1ce-423e-9bad-32139bf73cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:55:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Flow 'volume_create_manager' (b4bd530d-912b-4f1f-9cf7-93d753615245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:55:50 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c21a220b-684e-457e-a27c-f80b95ac4f98 tempest-AttachVolumeNegativeTest-838816842 None] Created volume successfully. Jun 16 08:55:51 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Jun 16 08:55:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee" returned: 0 in 0.708s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:55:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:55:51 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee Jun 16 08:55:51 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:55:51 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Jun 16 08:55:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2158fb41-53fa-40c4-aa9a-8eab903c44ee" returned: 0 in 0.606s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:55:51 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] Lock "cinder-quobyte-2158fb41-53fa-40c4-aa9a-8eab903c44ee" released by "delete_volume" :: held 1.377s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:55:51 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] Created reservations ['dc1512ac-7ce7-4900-96e3-030f426d10c9', '6c55c3b5-ef3c-41d8-a953-c3554f25efc8', 'd391b7d0-f098-48cb-9134-9f7734064dcf', '6814390e-d027-4930-be4a-4c270edfd803'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:55:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:55:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:55:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:55:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:55:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:55:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:55:51 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:55:51 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:55:52 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Jun 16 08:55:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.586s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:55:52 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:55:52 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] Deleted volume successfully. Jun 16 08:55:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c9feb777-d1d0-4987-b9df-51cb7099d11e tempest-TestStampPattern-772327495 None] Lock "cinder-2158fb41-53fa-40c4-aa9a-8eab903c44ee-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:55:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-31531ca3-0cf1-45aa-ba1c-bf3c301f5980 req-2f654530-70f7-4d95-8e72-f1be473f69b7 tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:55:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-31531ca3-0cf1-45aa-ba1c-bf3c301f5980 req-2f654530-70f7-4d95-8e72-f1be473f69b7 tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:55:54 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeedac6a-151f-44a9-9b77-8fd397714ac0]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:55:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-31531ca3-0cf1-45aa-ba1c-bf3c301f5980 req-2f654530-70f7-4d95-8e72-f1be473f69b7 tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-afe48eab-6460-47a9-b15c-a7d904eb4792 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:55:54 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-afe48eab-6460-47a9-b15c-a7d904eb4792 Jun 16 08:55:54 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:55:55 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Jun 16 08:55:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-31531ca3-0cf1-45aa-ba1c-bf3c301f5980 req-2f654530-70f7-4d95-8e72-f1be473f69b7 tempest-AttachVolumeNegativeTest-838816842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-afe48eab-6460-47a9-b15c-a7d904eb4792" returned: 0 in 0.751s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:55:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-31531ca3-0cf1-45aa-ba1c-bf3c301f5980 req-2f654530-70f7-4d95-8e72-f1be473f69b7 tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.780s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:55:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-31531ca3-0cf1-45aa-ba1c-bf3c301f5980 req-2f654530-70f7-4d95-8e72-f1be473f69b7 tempest-AttachVolumeNegativeTest-838816842 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-afe48eab-6460-47a9-b15c-a7d904eb4792', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c60d4881-fcd1-4fa3-9024-b6c31c207ff0', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 08:55:55 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-31531ca3-0cf1-45aa-ba1c-bf3c301f5980 req-2f654530-70f7-4d95-8e72-f1be473f69b7 tempest-AttachVolumeNegativeTest-838816842 None] attachment_update completed successfully. Jun 16 08:56:01 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-2a0c3e1b-a8a1-421c-892a-095dafa39ff5 req-dec7ce14-7559-45ad-89fb-27b4685d4c12 tempest-AttachVolumeNegativeTest-838816842 None] Terminate volume connection completed successfully. Jun 16 08:56:01 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-2a0c3e1b-a8a1-421c-892a-095dafa39ff5 req-dec7ce14-7559-45ad-89fb-27b4685d4c12 tempest-AttachVolumeNegativeTest-838816842 None] Deleting attachment c60d4881-fcd1-4fa3-9024-b6c31c207ff0. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Flow 'volume_create_manager' (618e8a84-5798-4dd2-a43f-6bc8219c9680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (888b8dbb-c1c5-41ea-9820-761b8b8dece6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (888b8dbb-c1c5-41ea-9820-761b8b8dece6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1254268131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3ada51-3f54-404c-aeaa-88f351dce0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41423c03e8b74f3c8571eec37aa89993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:03Z,use_quota=True,user_id='68be9b2e59cc4fa8b75aba5e641fba04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab19a13-ea9d-448f-a894-ae9e3d5a8e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab19a13-ea9d-448f-a894-ae9e3d5a8e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954edfa6-3d3b-4318-a7c6-d6778bb0a061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954edfa6-3d3b-4318-a7c6-d6778bb0a061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e3ada51-3f54-404c-aeaa-88f351dce0e6', 'volume_name': 'volume-4e3ada51-3f54-404c-aeaa-88f351dce0e6', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e4651d-95f3-428c-8629-39b22f74db21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e4651d-95f3-428c-8629-39b22f74db21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ec3544-44dd-4007-bb7d-f79e35658539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:02 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Volume 4e3ada51-3f54-404c-aeaa-88f351dce0e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e3ada51-3f54-404c-aeaa-88f351dce0e6', 'volume_size': 1} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1254268131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3ada51-3f54-404c-aeaa-88f351dce0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41423c03e8b74f3c8571eec37aa89993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:03Z,use_quota=True,user_id='68be9b2e59cc4fa8b75aba5e641fba04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Creating volume 4e3ada51-3f54-404c-aeaa-88f351dce0e6 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:56:02 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:56:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4e3ada51-3f54-404c-aeaa-88f351dce0e6 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:02 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4e3ada51-3f54-404c-aeaa-88f351dce0e6 1073741824 Jun 16 08:56:02 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Flow 'volume_create_manager' (ed996566-371c-4696-a6de-31e8e453b9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98a02f3-bc7b-462e-b248-40bdcda3fc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98a02f3-bc7b-462e-b248-40bdcda3fc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-631000035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf86253-0fd4-40af-bf4e-211b5511d75e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41423c03e8b74f3c8571eec37aa89993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:03Z,use_quota=True,user_id='68be9b2e59cc4fa8b75aba5e641fba04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb1ec80-e464-492a-811c-e702ebc49ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb1ec80-e464-492a-811c-e702ebc49ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee701c2f-2145-4d73-b061-8de0d468bb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee701c2f-2145-4d73-b061-8de0d468bb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf86253-0fd4-40af-bf4e-211b5511d75e', 'volume_name': 'volume-3bf86253-0fd4-40af-bf4e-211b5511d75e', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a9c027-e36d-4137-9bf7-fdf5f43dc4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a9c027-e36d-4137-9bf7-fdf5f43dc4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0079000-c643-4807-a969-728c8e2bb120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:03 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Volume 3bf86253-0fd4-40af-bf4e-211b5511d75e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf86253-0fd4-40af-bf4e-211b5511d75e', 'volume_size': 1} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Flow 'volume_create_manager' (fb21923e-ae5d-475b-86ac-92afa4c0e129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33908f9a-6fcd-4e49-bc9f-2e10cc299b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33908f9a-6fcd-4e49-bc9f-2e10cc299b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1580359676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cb288e9-4f1d-4c3e-8536-0618c6ebbe94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41423c03e8b74f3c8571eec37aa89993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:03Z,use_quota=True,user_id='68be9b2e59cc4fa8b75aba5e641fba04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf777ba-b276-45a8-9b32-59e52150f100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf777ba-b276-45a8-9b32-59e52150f100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f079693b-e5df-40e9-94f2-95cd68c5495a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f079693b-e5df-40e9-94f2-95cd68c5495a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cb288e9-4f1d-4c3e-8536-0618c6ebbe94', 'volume_name': 'volume-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7904f792-dcc8-4b90-9a6f-7f945004dd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7904f792-dcc8-4b90-9a6f-7f945004dd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7001927a-b56c-46bf-b666-eaa495c5283b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:03 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Volume 5cb288e9-4f1d-4c3e-8536-0618c6ebbe94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94', 'volume_size': 1} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:03 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4e3ada51-3f54-404c-aeaa-88f351dce0e6 1073741824" returned: 0 in 0.979s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4e3ada51-3f54-404c-aeaa-88f351dce0e6 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:03 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4e3ada51-3f54-404c-aeaa-88f351dce0e6 Jun 16 08:56:03 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Flow 'volume_create_manager' (c34faa23-d347-44d5-b469-6890c768ca80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d769a1-423f-4b6e-8c7c-066651b9d2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d769a1-423f-4b6e-8c7c-066651b9d2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1695418750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41423c03e8b74f3c8571eec37aa89993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:04Z,use_quota=True,user_id='68be9b2e59cc4fa8b75aba5e641fba04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba014380-3cef-47ae-b313-34ee98cf7241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba014380-3cef-47ae-b313-34ee98cf7241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a2a092-33b7-42a8-af2b-4c5e9150639f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a2a092-33b7-42a8-af2b-4c5e9150639f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd', 'volume_name': 'volume-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1115e869-c4c9-4d2e-b51b-d834b3cba8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1115e869-c4c9-4d2e-b51b-d834b3cba8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce57078c-9a20-45dc-ba8b-92b408d48de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:03 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Volume 0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd', 'volume_size': 1} Jun 16 08:56:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Flow 'volume_create_manager' (20de5ec7-bb30-4a1c-8d0a-d5c08a82dcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5da59ae-363b-4465-8094-614cb476f322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5da59ae-363b-4465-8094-614cb476f322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-785161819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa34378-541e-4b5f-bf65-f21b33618b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41423c03e8b74f3c8571eec37aa89993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:04Z,use_quota=True,user_id='68be9b2e59cc4fa8b75aba5e641fba04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2e7477-da86-49fe-8581-4276c8e93de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2e7477-da86-49fe-8581-4276c8e93de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bedf8d3-6656-4122-9023-21c4df9cfd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bedf8d3-6656-4122-9023-21c4df9cfd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fa34378-541e-4b5f-bf65-f21b33618b30', 'volume_name': 'volume-3fa34378-541e-4b5f-bf65-f21b33618b30', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a89383e-39a3-48c9-b41f-74a00bd50cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a89383e-39a3-48c9-b41f-74a00bd50cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9060b0b2-177c-4da0-999d-948c049aacb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:04 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Volume 3fa34378-541e-4b5f-bf65-f21b33618b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fa34378-541e-4b5f-bf65-f21b33618b30', 'volume_size': 1} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:04 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4e3ada51-3f54-404c-aeaa-88f351dce0e6" returned: 0 in 0.789s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.440s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-631000035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf86253-0fd4-40af-bf4e-211b5511d75e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41423c03e8b74f3c8571eec37aa89993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:03Z,use_quota=True,user_id='68be9b2e59cc4fa8b75aba5e641fba04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Creating volume 3bf86253-0fd4-40af-bf4e-211b5511d75e {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:56:04 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bf86253-0fd4-40af-bf4e-211b5511d75e 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:04 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bf86253-0fd4-40af-bf4e-211b5511d75e 1073741824 Jun 16 08:56:04 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ec3544-44dd-4007-bb7d-f79e35658539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e3ada51-3f54-404c-aeaa-88f351dce0e6', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7db7dc-3743-4601-8eef-f706e72b4a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:04 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Volume volume-4e3ada51-3f54-404c-aeaa-88f351dce0e6 (4e3ada51-3f54-404c-aeaa-88f351dce0e6): created successfully Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7db7dc-3743-4601-8eef-f706e72b4a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:04 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Flow 'volume_create_manager' (618e8a84-5798-4dd2-a43f-6bc8219c9680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:04 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-3ec24f8e-6aa8-4109-bf5c-e1be6301800a tempest-CreateVolumesFromImageTest-781525323 None] Created volume successfully. Jun 16 08:56:05 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bf86253-0fd4-40af-bf4e-211b5511d75e 1073741824" returned: 0 in 0.860s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bf86253-0fd4-40af-bf4e-211b5511d75e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:05 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bf86253-0fd4-40af-bf4e-211b5511d75e Jun 16 08:56:05 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:06 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bf86253-0fd4-40af-bf4e-211b5511d75e" returned: 0 in 0.642s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.584s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1580359676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cb288e9-4f1d-4c3e-8536-0618c6ebbe94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41423c03e8b74f3c8571eec37aa89993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:03Z,use_quota=True,user_id='68be9b2e59cc4fa8b75aba5e641fba04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Creating volume 5cb288e9-4f1d-4c3e-8536-0618c6ebbe94 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:56:06 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:06 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94 1073741824 Jun 16 08:56:06 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0079000-c643-4807-a969-728c8e2bb120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf86253-0fd4-40af-bf4e-211b5511d75e', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b1f2bf-f3c5-47ac-9566-3fa4bd2eef30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:06 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Volume volume-3bf86253-0fd4-40af-bf4e-211b5511d75e (3bf86253-0fd4-40af-bf4e-211b5511d75e): created successfully Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b1f2bf-f3c5-47ac-9566-3fa4bd2eef30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Flow 'volume_create_manager' (ed996566-371c-4696-a6de-31e8e453b9fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:06 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-b9f4963a-38d3-417e-a252-3b93a3295e2d tempest-CreateVolumesFromImageTest-781525323 None] Created volume successfully. Jun 16 08:56:06 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94 1073741824" returned: 0 in 0.858s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:07 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94 Jun 16 08:56:07 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:07 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94" returned: 0 in 0.579s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.654s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1695418750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41423c03e8b74f3c8571eec37aa89993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:04Z,use_quota=True,user_id='68be9b2e59cc4fa8b75aba5e641fba04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Creating volume 0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:56:07 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:07 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd 1073741824 Jun 16 08:56:07 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7001927a-b56c-46bf-b666-eaa495c5283b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ae02d4-f4be-46e5-9624-d8ee1563bc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:07 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Volume volume-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94 (5cb288e9-4f1d-4c3e-8536-0618c6ebbe94): created successfully Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ae02d4-f4be-46e5-9624-d8ee1563bc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Flow 'volume_create_manager' (fb21923e-ae5d-475b-86ac-92afa4c0e129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:07 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-886262b5-9e68-4d1b-9efb-4c4effe7e03e tempest-CreateVolumesFromImageTest-781525323 None] Created volume successfully. Jun 16 08:56:08 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd 1073741824" returned: 0 in 0.745s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:08 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd Jun 16 08:56:08 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:08 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd" returned: 0 in 0.595s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:08 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:56:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.530s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:08 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-785161819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa34378-541e-4b5f-bf65-f21b33618b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41423c03e8b74f3c8571eec37aa89993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:04Z,use_quota=True,user_id='68be9b2e59cc4fa8b75aba5e641fba04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:56:08 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Creating volume 3fa34378-541e-4b5f-bf65-f21b33618b30 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:56:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:08 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:08 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:08 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:56:08 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:56:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3fa34378-541e-4b5f-bf65-f21b33618b30 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:09 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3fa34378-541e-4b5f-bf65-f21b33618b30 1073741824 Jun 16 08:56:09 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce57078c-9a20-45dc-ba8b-92b408d48de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9de575-b78d-46d3-b25a-73aaff62325a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:09 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Volume volume-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd (0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd): created successfully Jun 16 08:56:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9de575-b78d-46d3-b25a-73aaff62325a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Flow 'volume_create_manager' (c34faa23-d347-44d5-b469-6890c768ca80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:09 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-7aff1c8a-ab63-498a-9295-dbe4d1a882b3 tempest-CreateVolumesFromImageTest-781525323 None] Created volume successfully. Jun 16 08:56:09 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3fa34378-541e-4b5f-bf65-f21b33618b30 1073741824" returned: 0 in 0.814s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3fa34378-541e-4b5f-bf65-f21b33618b30 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:09 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3fa34378-541e-4b5f-bf65-f21b33618b30 Jun 16 08:56:09 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:10 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3fa34378-541e-4b5f-bf65-f21b33618b30" returned: 0 in 0.592s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:10 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:56:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:10 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=36,cinder:UPDATE=43,cinder:INSERT=8,cinder:DELETE=4 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:56:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9060b0b2-177c-4da0-999d-948c049aacb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fa34378-541e-4b5f-bf65-f21b33618b30', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edfd102d-23cb-4761-b113-2f5ddc7083c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:10 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Volume volume-3fa34378-541e-4b5f-bf65-f21b33618b30 (3fa34378-541e-4b5f-bf65-f21b33618b30): created successfully Jun 16 08:56:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edfd102d-23cb-4761-b113-2f5ddc7083c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Flow 'volume_create_manager' (20de5ec7-bb30-4a1c-8d0a-d5c08a82dcc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:10 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-8b55cb7a-dcbc-4829-8149-5c55fe9740d0 tempest-CreateVolumesFromImageTest-781525323 None] Created volume successfully. Jun 16 08:56:10 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "cinder-3fa34378-541e-4b5f-bf65-f21b33618b30-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:10 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-3fa34378-541e-4b5f-bf65-f21b33618b30-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:10 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "cinder-quobyte-3fa34378-541e-4b5f-bf65-f21b33618b30" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:10 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-quobyte-3fa34378-541e-4b5f-bf65-f21b33618b30" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:10 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d091f0-6c92-4846-a5be-28e9dac6bcbb]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3fa34378-541e-4b5f-bf65-f21b33618b30 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:11 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3fa34378-541e-4b5f-bf65-f21b33618b30 Jun 16 08:56:11 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:11 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3fa34378-541e-4b5f-bf65-f21b33618b30" returned: 0 in 0.690s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3fa34378-541e-4b5f-bf65-f21b33618b30 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:11 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3fa34378-541e-4b5f-bf65-f21b33618b30 Jun 16 08:56:11 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:12 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3fa34378-541e-4b5f-bf65-f21b33618b30" returned: 0 in 0.630s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-quobyte-3fa34378-541e-4b5f-bf65-f21b33618b30" released by "delete_volume" :: held 1.362s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:12 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] Created reservations ['1222d2bd-fba7-4c79-b724-bf8f1ed149f6', '4378a8f3-c20a-4db1-91f6-5437d2c28cfd', '88795918-07ea-4110-aa78-9ad6f3ee17d3', '6cedf057-c032-4a93-bea0-e18beb8618df'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:12 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:12 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "cinder-afe48eab-6460-47a9-b15c-a7d904eb4792-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] Lock "cinder-afe48eab-6460-47a9-b15c-a7d904eb4792-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "cinder-quobyte-afe48eab-6460-47a9-b15c-a7d904eb4792" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] Lock "cinder-quobyte-afe48eab-6460-47a9-b15c-a7d904eb4792" acquired by "delete_volume" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:12 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6371b418-eb8e-45e4-88f8-4183a7330c81]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-afe48eab-6460-47a9-b15c-a7d904eb4792 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:12 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-afe48eab-6460-47a9-b15c-a7d904eb4792 Jun 16 08:56:12 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:13 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.615s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:13 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:13 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] Deleted volume successfully. Jun 16 08:56:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4f2b03aa-3094-410f-ab7c-750dc14f7f68 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-3fa34378-541e-4b5f-bf65-f21b33618b30-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "cinder-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "cinder-quobyte-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-quobyte-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd" acquired by "delete_volume" :: waited 0.031s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:13 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f83620-bb53-4126-bf37-8f6c83185dbe]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:13 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd Jun 16 08:56:13 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:13 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-afe48eab-6460-47a9-b15c-a7d904eb4792" returned: 0 in 0.707s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-afe48eab-6460-47a9-b15c-a7d904eb4792 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:13 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-afe48eab-6460-47a9-b15c-a7d904eb4792 Jun 16 08:56:13 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:13 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd" returned: 0 in 0.745s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:13 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd Jun 16 08:56:13 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:14 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-afe48eab-6460-47a9-b15c-a7d904eb4792" returned: 0 in 0.603s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] Lock "cinder-quobyte-afe48eab-6460-47a9-b15c-a7d904eb4792" released by "delete_volume" :: held 1.358s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=53,cinder:UPDATE=55,cinder:INSERT=13,cinder:DELETE=5 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] Created reservations ['c7954fb7-989a-48ea-ac07-0447534f16dd', 'adf7916c-25fe-468a-9abd-0ec8d6e5dc61', '562c8718-bc29-40c3-bd3d-5c3685c9c496', '8a5b1534-39fe-415b-a924-f4ccb46fa3f6'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:14 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:14 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:14 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd" returned: 0 in 0.612s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-quobyte-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd" released by "delete_volume" :: held 1.396s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] Created reservations ['2ba19477-b6c2-4a50-9c1c-49e7eb59180a', 'e82b8ebc-3308-4c00-af5c-96c957d1b171', 'dc3f6558-7271-4129-a44c-ab9b1c85c41f', 'a78ce138-c93d-4265-89f0-2d3c727071e8'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:14 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:14 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:14 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.590s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:14 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] Deleted volume successfully. Jun 16 08:56:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4e114724-9701-4181-b34b-6db71685681b tempest-AttachVolumeNegativeTest-838816842 None] Lock "cinder-afe48eab-6460-47a9-b15c-a7d904eb4792-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "cinder-8be102f9-9d39-43e9-8e0d-462ccd862aff-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] Lock "cinder-8be102f9-9d39-43e9-8e0d-462ccd862aff-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "cinder-quobyte-8be102f9-9d39-43e9-8e0d-462ccd862aff" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] Lock "cinder-quobyte-8be102f9-9d39-43e9-8e0d-462ccd862aff" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:15 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ae66fb-0702-4302-9a99-1fbe8f83b6d6]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8be102f9-9d39-43e9-8e0d-462ccd862aff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:15 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8be102f9-9d39-43e9-8e0d-462ccd862aff Jun 16 08:56:15 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:15 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.621s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:15 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "cinder-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:15 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] Deleted volume successfully. Jun 16 08:56:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-eee01cf9-e450-4f03-8f58-64d5db95b047 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-0a1a79cd-f24e-4ccf-b160-c90d13ca5cdd-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "cinder-quobyte-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-quobyte-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94" acquired by "delete_volume" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:15 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8579163f-c863-403e-ae7e-c87e232ad9f5]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:15 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94 Jun 16 08:56:15 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:15 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8be102f9-9d39-43e9-8e0d-462ccd862aff" returned: 0 in 0.727s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8be102f9-9d39-43e9-8e0d-462ccd862aff {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:15 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8be102f9-9d39-43e9-8e0d-462ccd862aff Jun 16 08:56:15 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:16 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94" returned: 0 in 0.763s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:16 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94 Jun 16 08:56:16 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:16 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-8be102f9-9d39-43e9-8e0d-462ccd862aff" returned: 0 in 0.597s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] Lock "cinder-quobyte-8be102f9-9d39-43e9-8e0d-462ccd862aff" released by "delete_volume" :: held 1.377s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] Created reservations ['3f7e8488-b912-4bf1-8800-8bae44a6556b', '25e66b1b-e298-4ecd-bbc6-eda2580b3282', '698d2cef-b985-4736-89d0-c1db5162b5aa', 'e64a7b6b-83f7-421b-bb95-8fd7be952427'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:16 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:16 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:16 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94" returned: 0 in 0.591s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-quobyte-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94" released by "delete_volume" :: held 1.392s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] Created reservations ['91bb398e-ee5a-4b25-bef5-e65a642bf690', '49713237-5200-4a86-955b-e317da7f925b', '65c4f070-8f21-40b6-9ded-29fc52ecf5b5', '64823e76-7b5c-42a0-b8ca-35e8da77c2fe'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:16 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:16 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:17 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.622s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:17 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] Deleted volume successfully. Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b0f70773-287d-49ae-90db-1533f56d7a12 tempest-AttachVolumeNegativeTest-838816842 None] Lock "cinder-8be102f9-9d39-43e9-8e0d-462ccd862aff-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "cinder-4a5af230-d83c-43a7-9a87-ce6069d9f21b-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] Lock "cinder-4a5af230-d83c-43a7-9a87-ce6069d9f21b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "cinder-quobyte-4a5af230-d83c-43a7-9a87-ce6069d9f21b" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] Lock "cinder-quobyte-4a5af230-d83c-43a7-9a87-ce6069d9f21b" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[915802a2-76a7-4582-bf88-9191acf67d78]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:17 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.640s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:17 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] Deleted volume successfully. Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "cinder-3bf86253-0fd4-40af-bf4e-211b5511d75e-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b8b46732-c2a6-4d6c-845f-7adfe08cd856 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-5cb288e9-4f1d-4c3e-8536-0618c6ebbe94-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-3bf86253-0fd4-40af-bf4e-211b5511d75e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:17 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b Jun 16 08:56:17 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "cinder-quobyte-3bf86253-0fd4-40af-bf4e-211b5511d75e" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-quobyte-3bf86253-0fd4-40af-bf4e-211b5511d75e" acquired by "delete_volume" :: waited 0.014s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[23297394-98f7-40f8-8364-99f3a38d003b]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bf86253-0fd4-40af-bf4e-211b5511d75e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:17 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bf86253-0fd4-40af-bf4e-211b5511d75e Jun 16 08:56:17 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:18 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b" returned: 0 in 0.729s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:18 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b Jun 16 08:56:18 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:18 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bf86253-0fd4-40af-bf4e-211b5511d75e" returned: 0 in 0.731s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bf86253-0fd4-40af-bf4e-211b5511d75e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:18 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bf86253-0fd4-40af-bf4e-211b5511d75e Jun 16 08:56:18 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:18 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4a5af230-d83c-43a7-9a87-ce6069d9f21b" returned: 0 in 0.626s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:18 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] Lock "cinder-quobyte-4a5af230-d83c-43a7-9a87-ce6069d9f21b" released by "delete_volume" :: held 1.410s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:18 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] Created reservations ['c6da6412-540c-4e62-b025-df383dbb84fc', '2c86b669-2899-4775-a9b5-62e414a5efc5', '2af3e133-eca2-45d8-8250-7d5a06e6c14c', '19bb55b4-3d16-4a51-9f5c-dfb30599cacc'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:19 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3bf86253-0fd4-40af-bf4e-211b5511d75e" returned: 0 in 0.603s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:19 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:19 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-quobyte-3bf86253-0fd4-40af-bf4e-211b5511d75e" released by "delete_volume" :: held 1.376s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] Created reservations ['5c4b0fb7-edca-4ba7-8d3c-559a96fb5e5f', '39d3c811-4e29-408f-88d6-e3deb5f312c9', '95d9a222-8bd4-4260-b019-5527a2eb544d', 'c8fa7da8-6d46-463b-b474-f9c18facc00f'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:19 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:19 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:19 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.598s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:19 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] Deleted volume successfully. Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-86ff1459-2151-408c-b33c-d0feb4afaaad tempest-AttachVolumeNegativeTest-838816842 None] Lock "cinder-4a5af230-d83c-43a7-9a87-ce6069d9f21b-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:19 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.606s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:19 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] Deleted volume successfully. Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-da2298ba-dbc9-4d24-a861-fb583cb72041 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-3bf86253-0fd4-40af-bf4e-211b5511d75e-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "cinder-4e3ada51-3f54-404c-aeaa-88f351dce0e6-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-4e3ada51-3f54-404c-aeaa-88f351dce0e6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "cinder-quobyte-4e3ada51-3f54-404c-aeaa-88f351dce0e6" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-quobyte-4e3ada51-3f54-404c-aeaa-88f351dce0e6" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2a2698-84d3-4397-a827-e92f19a37f6f]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4e3ada51-3f54-404c-aeaa-88f351dce0e6 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:20 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4e3ada51-3f54-404c-aeaa-88f351dce0e6 Jun 16 08:56:20 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:20 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4e3ada51-3f54-404c-aeaa-88f351dce0e6" returned: 0 in 0.721s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4e3ada51-3f54-404c-aeaa-88f351dce0e6 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:20 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4e3ada51-3f54-404c-aeaa-88f351dce0e6 Jun 16 08:56:20 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:21 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4e3ada51-3f54-404c-aeaa-88f351dce0e6" returned: 0 in 0.634s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:21 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-quobyte-4e3ada51-3f54-404c-aeaa-88f351dce0e6" released by "delete_volume" :: held 1.402s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:21 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] Created reservations ['98a3b7d0-ad6f-4cf1-b103-d7b7cf14f1f7', '56ceba93-4bec-4a91-ad44-c3fa1e1b596c', '99e97dbb-ccaa-4bf0-ba89-3b23451f6b40', '1a25f5e9-e23c-4396-b62e-28d315c9541e'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:21 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:21 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:22 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.595s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:22 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:22 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] Deleted volume successfully. Jun 16 08:56:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-419ab638-44ef-4718-8983-2e6eb30c91e3 tempest-CreateVolumesFromImageTest-781525323 None] Lock "cinder-4e3ada51-3f54-404c-aeaa-88f351dce0e6-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Flow 'volume_create_manager' (fc5662d5-3ed9-4903-8097-81d123b9c795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d438cbd5-14cf-40f8-8788-4e4643a789e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d438cbd5-14cf-40f8-8788-4e4643a789e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1942952620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92517f5a-2d44-4912-b59a-3258c84ab4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2242f22d1af47679bc3288f1aa96b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:25Z,use_quota=True,user_id='8d4a7e40525f4eb58ab0216bd8286cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e955504a-c2ef-41f7-8a8e-0ed219b42c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e955504a-c2ef-41f7-8a8e-0ed219b42c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9d8a97-5f45-4e9c-b2b7-3acc791b540a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9d8a97-5f45-4e9c-b2b7-3acc791b540a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92517f5a-2d44-4912-b59a-3258c84ab4da', 'volume_name': 'volume-92517f5a-2d44-4912-b59a-3258c84ab4da', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446a4622-87aa-454c-a177-81b010d20b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446a4622-87aa-454c-a177-81b010d20b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166a1a7d-8712-4bb5-a5b3-6f0a0e75fe22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:25 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume 92517f5a-2d44-4912-b59a-3258c84ab4da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92517f5a-2d44-4912-b59a-3258c84ab4da', 'volume_size': 1} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1942952620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92517f5a-2d44-4912-b59a-3258c84ab4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2242f22d1af47679bc3288f1aa96b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:25Z,use_quota=True,user_id='8d4a7e40525f4eb58ab0216bd8286cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Creating volume 92517f5a-2d44-4912-b59a-3258c84ab4da {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:56:25 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:56:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:25 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da 1073741824 Jun 16 08:56:25 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:25 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da 1073741824" returned: 0 in 0.803s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:26 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da Jun 16 08:56:26 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Flow 'volume_create_manager' (7ef1edf3-b95e-4659-9601-2ad2010f1916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542bf5dd-7c9a-4395-b516-5889ff77e9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542bf5dd-7c9a-4395-b516-5889ff77e9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1369406313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed2d165-e3c1-4e96-9cb7-143ee98f6770,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='30efb88aa3bb464f89442c158af63fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:26Z,use_quota=True,user_id='6b291eb33e414ae680fdf557f286f591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c76348-d7f8-4b50-8941-fa73213e3707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c76348-d7f8-4b50-8941-fa73213e3707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dab8c0c-accb-4998-97df-7b530d06b50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dab8c0c-accb-4998-97df-7b530d06b50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ed2d165-e3c1-4e96-9cb7-143ee98f6770', 'volume_name': 'volume-4ed2d165-e3c1-4e96-9cb7-143ee98f6770', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6e663e-cfd7-442b-9629-ea156c980642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6e663e-cfd7-442b-9629-ea156c980642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42eda84c-32f1-4d32-8208-e5e6091707f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:26 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Volume 4ed2d165-e3c1-4e96-9cb7-143ee98f6770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ed2d165-e3c1-4e96-9cb7-143ee98f6770', 'volume_size': 1} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:26 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da" returned: 0 in 0.620s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.386s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1369406313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed2d165-e3c1-4e96-9cb7-143ee98f6770,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='30efb88aa3bb464f89442c158af63fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:26Z,use_quota=True,user_id='6b291eb33e414ae680fdf557f286f591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Creating volume 4ed2d165-e3c1-4e96-9cb7-143ee98f6770 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:56:26 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4ed2d165-e3c1-4e96-9cb7-143ee98f6770 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166a1a7d-8712-4bb5-a5b3-6f0a0e75fe22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92517f5a-2d44-4912-b59a-3258c84ab4da', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:26 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4ed2d165-e3c1-4e96-9cb7-143ee98f6770 1073741824 Jun 16 08:56:26 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb28692-66a4-4b1f-a649-90ecdeebaf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:26 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume volume-92517f5a-2d44-4912-b59a-3258c84ab4da (92517f5a-2d44-4912-b59a-3258c84ab4da): created successfully Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb28692-66a4-4b1f-a649-90ecdeebaf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Flow 'volume_create_manager' (fc5662d5-3ed9-4903-8097-81d123b9c795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:26 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-a8b67f49-c339-45d7-b117-e514f2975417 tempest-CreateVolumesFromSnapshotTest-822115443 None] Created volume successfully. Jun 16 08:56:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:27 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4ed2d165-e3c1-4e96-9cb7-143ee98f6770 1073741824" returned: 0 in 0.842s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4ed2d165-e3c1-4e96-9cb7-143ee98f6770 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:27 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4ed2d165-e3c1-4e96-9cb7-143ee98f6770 Jun 16 08:56:27 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:28 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4ed2d165-e3c1-4e96-9cb7-143ee98f6770" returned: 0 in 0.602s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.694s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42eda84c-32f1-4d32-8208-e5e6091707f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed2d165-e3c1-4e96-9cb7-143ee98f6770', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd303a0a-629b-4bd1-8427-9849de1b011b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] Creating offline snapshot 5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab of volume 92517f5a-2d44-4912-b59a-3258c84ab4da {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6de184b-96c5-4c47-a803-1c202e11295b]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:28 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Volume volume-4ed2d165-e3c1-4e96-9cb7-143ee98f6770 (4ed2d165-e3c1-4e96-9cb7-143ee98f6770): created successfully Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd303a0a-629b-4bd1-8427-9849de1b011b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Flow 'volume_create_manager' (7ef1edf3-b95e-4659-9601-2ad2010f1916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-28d52b74-657c-4418-bd26-b435d00c2630 tempest-VolumesTestJSON-308607296 None] Created volume successfully. Jun 16 08:56:28 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da Jun 16 08:56:28 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Flow 'volume_create_manager' (ac6dafc2-a0a9-4e57-a709-5d470a7c2015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366d7124-670e-486c-ae28-97103f00bb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366d7124-670e-486c-ae28-97103f00bb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-845359562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e67ebf-d1e0-4069-b9ad-a490472ebe5f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='30efb88aa3bb464f89442c158af63fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:29Z,use_quota=True,user_id='6b291eb33e414ae680fdf557f286f591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7859c9-131c-4753-8ba1-1d57869a14dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7859c9-131c-4753-8ba1-1d57869a14dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa75ab19-9688-47cc-9c01-2dd6bc204aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa75ab19-9688-47cc-9c01-2dd6bc204aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1e67ebf-d1e0-4069-b9ad-a490472ebe5f', 'volume_name': 'volume-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b68966a-646e-4996-b359-12315be81709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b68966a-646e-4996-b359-12315be81709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75dcf5e5-a6f4-457f-a00c-af88ae6f7816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:28 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Volume d1e67ebf-d1e0-4069-b9ad-a490472ebe5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f', 'volume_size': 1} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:28 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da" returned: 0 in 0.714s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:28 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab 1G Jun 16 08:56:28 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:29 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab 1G" returned: 0 in 0.755s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92517f5a-2d44-4912-b59a-3258c84ab4da -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:29 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92517f5a-2d44-4912-b59a-3258c84ab4da -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab Jun 16 08:56:29 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:56:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:30 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:30 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:30 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92517f5a-2d44-4912-b59a-3258c84ab4da -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab" returned: 0 in 0.629s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:30 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab is being set with open permissions: ugo+rw Jun 16 08:56:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:30 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab Jun 16 08:56:30 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:30 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.585s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:30 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:56:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:56:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:56:30 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab" returned: 0 in 0.601s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:30 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.info Jun 16 08:56:30 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:31 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.info" returned: 0 in 0.571s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:31 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.info is being set with open permissions: ugo+rw Jun 16 08:56:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:31 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.info Jun 16 08:56:31 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:32 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.info" returned: 0 in 0.581s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.941s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.233s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-845359562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e67ebf-d1e0-4069-b9ad-a490472ebe5f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='30efb88aa3bb464f89442c158af63fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:29Z,use_quota=True,user_id='6b291eb33e414ae680fdf557f286f591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:56:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Creating volume d1e67ebf-d1e0-4069-b9ad-a490472ebe5f {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:56:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:56:32 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:56:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:32 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f 1073741824 Jun 16 08:56:32 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:32 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-cbcd7713-9bf9-41e8-9ed7-4f6fa27852f1 tempest-CreateVolumesFromSnapshotTest-822115443 None] Create snapshot completed successfully Jun 16 08:56:32 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f 1073741824" returned: 0 in 0.766s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:32 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f Jun 16 08:56:32 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Flow 'volume_create_manager' (8d4bc5f5-e6dd-44bc-95e2-11ca4b6e5446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d32e262-639b-4c3b-a2b0-c3be3ee12202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d32e262-639b-4c3b-a2b0-c3be3ee12202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-225300251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98c07df-8b34-428c-a964-0624e927ba39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2242f22d1af47679bc3288f1aa96b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:33Z,use_quota=True,user_id='8d4a7e40525f4eb58ab0216bd8286cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224ebd81-ebbc-4d38-ac22-1f7607f6deb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224ebd81-ebbc-4d38-ac22-1f7607f6deb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bd24a3-ba42-497d-adfc-c813a569764e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bd24a3-ba42-497d-adfc-c813a569764e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e98c07df-8b34-428c-a964-0624e927ba39', 'volume_name': 'volume-e98c07df-8b34-428c-a964-0624e927ba39', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772ee0b9-db68-4117-8f68-6734870b8455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772ee0b9-db68-4117-8f68-6734870b8455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9f454c-b0b0-49c0-a18d-1153a4c27704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:33 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume e98c07df-8b34-428c-a964-0624e927ba39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e98c07df-8b34-428c-a964-0624e927ba39', 'volume_size': 1} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Flow 'volume_create_manager' (7f80bcbc-37d9-419f-9c67-d127cc7d2999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220b0063-7e85-4776-b85a-1ff7c4b2008e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220b0063-7e85-4776-b85a-1ff7c4b2008e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1690355360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2242f22d1af47679bc3288f1aa96b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:33Z,use_quota=True,user_id='8d4a7e40525f4eb58ab0216bd8286cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f8dc99-e71d-4f86-a7b9-d74789480fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f8dc99-e71d-4f86-a7b9-d74789480fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6c6719-7501-4d0b-88a3-ab5a2bc85333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6c6719-7501-4d0b-88a3-ab5a2bc85333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d', 'volume_name': 'volume-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96ef465-8b2f-48dd-88d7-f1e10bc56a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96ef465-8b2f-48dd-88d7-f1e10bc56a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c7fbfa-7140-4c9d-8ff3-a76ab1dcf5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:33 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume 4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d', 'volume_size': 1} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:33 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f" returned: 0 in 0.667s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.468s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-225300251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98c07df-8b34-428c-a964-0624e927ba39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2242f22d1af47679bc3288f1aa96b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:33Z,use_quota=True,user_id='8d4a7e40525f4eb58ab0216bd8286cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Creating volume e98c07df-8b34-428c-a964-0624e927ba39 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:56:33 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e98c07df-8b34-428c-a964-0624e927ba39 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:33 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e98c07df-8b34-428c-a964-0624e927ba39 1073741824 Jun 16 08:56:33 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75dcf5e5-a6f4-457f-a00c-af88ae6f7816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ece519-5a24-41a8-9fea-2c59e97bf27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:33 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Volume volume-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f (d1e67ebf-d1e0-4069-b9ad-a490472ebe5f): created successfully Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ece519-5a24-41a8-9fea-2c59e97bf27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Flow 'volume_create_manager' (ac6dafc2-a0a9-4e57-a709-5d470a7c2015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:33 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-65e24c64-7464-4f99-91e5-8844ee8563be tempest-VolumesTestJSON-308607296 None] Created volume successfully. Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Flow 'volume_create_manager' (b66f0820-5853-4cb0-8302-2f35f945ae3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7eac7ec-8809-4c8b-b22a-8536677f87f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7eac7ec-8809-4c8b-b22a-8536677f87f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1705248703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9483c8c0-1f1e-487d-b14a-7e8e84131531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2242f22d1af47679bc3288f1aa96b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:34Z,use_quota=True,user_id='8d4a7e40525f4eb58ab0216bd8286cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471b9bf6-62a9-438b-a8e2-610e1c36e1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471b9bf6-62a9-438b-a8e2-610e1c36e1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed4791d-fc96-4f69-a64d-81da211d6d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed4791d-fc96-4f69-a64d-81da211d6d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9483c8c0-1f1e-487d-b14a-7e8e84131531', 'volume_name': 'volume-9483c8c0-1f1e-487d-b14a-7e8e84131531', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8292e1e-0438-43be-b076-4b1fb7fa2359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8292e1e-0438-43be-b076-4b1fb7fa2359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14430f45-50e4-402b-b801-27d2670746e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:33 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume 9483c8c0-1f1e-487d-b14a-7e8e84131531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9483c8c0-1f1e-487d-b14a-7e8e84131531', 'volume_size': 1} Jun 16 08:56:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Flow 'volume_create_manager' (ce4bfd4f-a391-43bb-bf27-bc1c8422288a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68173760-2c72-4d43-a4ee-92b8f7f6f2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68173760-2c72-4d43-a4ee-92b8f7f6f2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1902912924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba041ef8-7226-4d91-8377-dc9200e2e363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2242f22d1af47679bc3288f1aa96b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:34Z,use_quota=True,user_id='8d4a7e40525f4eb58ab0216bd8286cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec92f6ce-cb25-4929-8dd0-d717ea66e916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec92f6ce-cb25-4929-8dd0-d717ea66e916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c3ae43-e9ca-43f6-a152-cfd4418b8161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c3ae43-e9ca-43f6-a152-cfd4418b8161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba041ef8-7226-4d91-8377-dc9200e2e363', 'volume_name': 'volume-ba041ef8-7226-4d91-8377-dc9200e2e363', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53a8bc4-af28-4e2c-8ddb-9c7ff1688ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53a8bc4-af28-4e2c-8ddb-9c7ff1688ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e57844b-ed8e-45fc-9cac-0e1addb8600b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:34 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume ba041ef8-7226-4d91-8377-dc9200e2e363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba041ef8-7226-4d91-8377-dc9200e2e363', 'volume_size': 1} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Flow 'volume_create_manager' (49e8e7eb-7d5e-4fec-a1f6-7d5c8c533183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385d4033-1fa1-48b7-8af6-ecc73f88f9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385d4033-1fa1-48b7-8af6-ecc73f88f9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1730594412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2783fbc-0c4b-4e91-ab9e-7f205a4f402e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2242f22d1af47679bc3288f1aa96b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:34Z,use_quota=True,user_id='8d4a7e40525f4eb58ab0216bd8286cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358cbc57-12e8-4107-a976-112513fd68bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358cbc57-12e8-4107-a976-112513fd68bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77b7b55-09d1-4131-aa4c-c08058e497a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77b7b55-09d1-4131-aa4c-c08058e497a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2783fbc-0c4b-4e91-ab9e-7f205a4f402e', 'volume_name': 'volume-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bddcd5d-9754-439c-b9ba-341ee9bf7d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bddcd5d-9754-439c-b9ba-341ee9bf7d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f9e71c-90bc-4a43-b2e3-2ce6ff1abe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:34 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume e2783fbc-0c4b-4e91-ab9e-7f205a4f402e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e', 'volume_size': 1} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:34 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e98c07df-8b34-428c-a964-0624e927ba39 1073741824" returned: 0 in 0.964s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e98c07df-8b34-428c-a964-0624e927ba39 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:34 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e98c07df-8b34-428c-a964-0624e927ba39 Jun 16 08:56:34 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Flow 'volume_create_manager' (a238ccfc-8e50-4dfb-85c1-89f8658c7d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0038f6-bfc1-4e6e-866a-4dfe56993187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0038f6-bfc1-4e6e-866a-4dfe56993187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-226951806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5875c9b4-6290-4828-9554-c8fa974f5ff2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='30efb88aa3bb464f89442c158af63fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:35Z,use_quota=True,user_id='6b291eb33e414ae680fdf557f286f591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35a6507-858d-4e0f-bcb4-8da2690e3275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35a6507-858d-4e0f-bcb4-8da2690e3275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57fbafb-ba79-4508-905e-4a1ce543f66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57fbafb-ba79-4508-905e-4a1ce543f66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5875c9b4-6290-4828-9554-c8fa974f5ff2', 'volume_name': 'volume-5875c9b4-6290-4828-9554-c8fa974f5ff2', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27dbd533-565d-4135-be0d-5c7554f50fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27dbd533-565d-4135-be0d-5c7554f50fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdcfef8c-2b08-4a82-b148-26cf20754566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:34 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Volume 5875c9b4-6290-4828-9554-c8fa974f5ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5875c9b4-6290-4828-9554-c8fa974f5ff2', 'volume_size': 1} Jun 16 08:56:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:35 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e98c07df-8b34-428c-a964-0624e927ba39" returned: 0 in 0.595s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.746s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1690355360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2242f22d1af47679bc3288f1aa96b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:33Z,use_quota=True,user_id='8d4a7e40525f4eb58ab0216bd8286cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Creating volume 4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:56:35 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9f454c-b0b0-49c0-a18d-1153a4c27704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e98c07df-8b34-428c-a964-0624e927ba39', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:35 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d 1073741824 Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc39ac81-a84b-4cb8-bc0e-b8185971a817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:35 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:35 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume volume-e98c07df-8b34-428c-a964-0624e927ba39 (e98c07df-8b34-428c-a964-0624e927ba39): created successfully Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc39ac81-a84b-4cb8-bc0e-b8185971a817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Flow 'volume_create_manager' (8d4bc5f5-e6dd-44bc-95e2-11ca4b6e5446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:35 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-f1b5d9ea-2a4d-4d45-bd82-cc91d753f4c6 tempest-CreateVolumesFromSnapshotTest-822115443 None] Created volume successfully. Jun 16 08:56:35 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d 1073741824" returned: 0 in 0.733s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:35 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d Jun 16 08:56:35 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:36 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d" returned: 0 in 0.574s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:56:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.717s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1705248703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9483c8c0-1f1e-487d-b14a-7e8e84131531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2242f22d1af47679bc3288f1aa96b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:34Z,use_quota=True,user_id='8d4a7e40525f4eb58ab0216bd8286cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:56:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Creating volume 9483c8c0-1f1e-487d-b14a-7e8e84131531 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:56:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:56:36 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:56:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9483c8c0-1f1e-487d-b14a-7e8e84131531 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:36 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9483c8c0-1f1e-487d-b14a-7e8e84131531 1073741824 Jun 16 08:56:36 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c7fbfa-7140-4c9d-8ff3-a76ab1dcf5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb3d424-99d9-4dc3-8b96-25331a8611c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:36 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume volume-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d (4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d): created successfully Jun 16 08:56:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb3d424-99d9-4dc3-8b96-25331a8611c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Flow 'volume_create_manager' (7f80bcbc-37d9-419f-9c67-d127cc7d2999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:36 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-40caab58-08f2-4230-be81-536735951b51 tempest-CreateVolumesFromSnapshotTest-822115443 None] Created volume successfully. Jun 16 08:56:37 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9483c8c0-1f1e-487d-b14a-7e8e84131531 1073741824" returned: 0 in 0.745s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9483c8c0-1f1e-487d-b14a-7e8e84131531 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:37 devstack sudo[108573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9483c8c0-1f1e-487d-b14a-7e8e84131531 Jun 16 08:56:37 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:37 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9483c8c0-1f1e-487d-b14a-7e8e84131531" returned: 0 in 0.570s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.694s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1902912924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba041ef8-7226-4d91-8377-dc9200e2e363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2242f22d1af47679bc3288f1aa96b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:34Z,use_quota=True,user_id='8d4a7e40525f4eb58ab0216bd8286cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Creating volume ba041ef8-7226-4d91-8377-dc9200e2e363 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:56:37 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ba041ef8-7226-4d91-8377-dc9200e2e363 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:37 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ba041ef8-7226-4d91-8377-dc9200e2e363 1073741824 Jun 16 08:56:37 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14430f45-50e4-402b-b801-27d2670746e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9483c8c0-1f1e-487d-b14a-7e8e84131531', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eddd4b18-3709-4fc0-a556-48fa5096f7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:37 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume volume-9483c8c0-1f1e-487d-b14a-7e8e84131531 (9483c8c0-1f1e-487d-b14a-7e8e84131531): created successfully Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eddd4b18-3709-4fc0-a556-48fa5096f7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Flow 'volume_create_manager' (b66f0820-5853-4cb0-8302-2f35f945ae3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:37 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c95f53f8-e506-490d-bffa-cc93a94dfb4d tempest-CreateVolumesFromSnapshotTest-822115443 None] Created volume successfully. Jun 16 08:56:38 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ba041ef8-7226-4d91-8377-dc9200e2e363 1073741824" returned: 0 in 0.741s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ba041ef8-7226-4d91-8377-dc9200e2e363 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:38 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ba041ef8-7226-4d91-8377-dc9200e2e363 Jun 16 08:56:38 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:39 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ba041ef8-7226-4d91-8377-dc9200e2e363" returned: 0 in 0.574s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:56:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.743s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1730594412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2783fbc-0c4b-4e91-ab9e-7f205a4f402e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2242f22d1af47679bc3288f1aa96b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:34Z,use_quota=True,user_id='8d4a7e40525f4eb58ab0216bd8286cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:56:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Creating volume e2783fbc-0c4b-4e91-ab9e-7f205a4f402e {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:56:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:56:39 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:56:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e57844b-ed8e-45fc-9cac-0e1addb8600b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba041ef8-7226-4d91-8377-dc9200e2e363', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:39 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e 1073741824 Jun 16 08:56:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b741497a-d63b-4c21-adc3-c4808b09a9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:39 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:39 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume volume-ba041ef8-7226-4d91-8377-dc9200e2e363 (ba041ef8-7226-4d91-8377-dc9200e2e363): created successfully Jun 16 08:56:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b741497a-d63b-4c21-adc3-c4808b09a9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Flow 'volume_create_manager' (ce4bfd4f-a391-43bb-bf27-bc1c8422288a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:39 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-b98aa3e4-5107-4c7d-ada3-506bbf17fa09 tempest-CreateVolumesFromSnapshotTest-822115443 None] Created volume successfully. Jun 16 08:56:40 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e 1073741824" returned: 0 in 0.773s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:40 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e Jun 16 08:56:40 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:40 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e" returned: 0 in 0.585s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.941s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-226951806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5875c9b4-6290-4828-9554-c8fa974f5ff2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='30efb88aa3bb464f89442c158af63fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:56:35Z,use_quota=True,user_id='6b291eb33e414ae680fdf557f286f591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Creating volume 5875c9b4-6290-4828-9554-c8fa974f5ff2 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:56:40 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5875c9b4-6290-4828-9554-c8fa974f5ff2 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:40 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5875c9b4-6290-4828-9554-c8fa974f5ff2 1073741824 Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f9e71c-90bc-4a43-b2e3-2ce6ff1abe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:40 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486fbbaf-01a0-4710-a437-224c097864a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:40 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Volume volume-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e (e2783fbc-0c4b-4e91-ab9e-7f205a4f402e): created successfully Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486fbbaf-01a0-4710-a437-224c097864a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Flow 'volume_create_manager' (49e8e7eb-7d5e-4fec-a1f6-7d5c8c533183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:40 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-a8c30122-d355-42d3-8e6b-552f8f83ea5d tempest-CreateVolumesFromSnapshotTest-822115443 None] Created volume successfully. Jun 16 08:56:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "cinder-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "cinder-quobyte-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-quobyte-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:41 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[12209e14-06b7-459a-abd8-806843affad9]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:41 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e Jun 16 08:56:41 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:41 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5875c9b4-6290-4828-9554-c8fa974f5ff2 1073741824" returned: 0 in 0.789s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5875c9b4-6290-4828-9554-c8fa974f5ff2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:41 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5875c9b4-6290-4828-9554-c8fa974f5ff2 Jun 16 08:56:41 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:41 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e" returned: 0 in 0.709s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:41 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e Jun 16 08:56:41 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:42 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5875c9b4-6290-4828-9554-c8fa974f5ff2" returned: 0 in 0.578s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:56:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdcfef8c-2b08-4a82-b148-26cf20754566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5875c9b4-6290-4828-9554-c8fa974f5ff2', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9c3dac-4732-4cf7-9050-df47c198aa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:56:42 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Volume volume-5875c9b4-6290-4828-9554-c8fa974f5ff2 (5875c9b4-6290-4828-9554-c8fa974f5ff2): created successfully Jun 16 08:56:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9c3dac-4732-4cf7-9050-df47c198aa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:56:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Flow 'volume_create_manager' (a238ccfc-8e50-4dfb-85c1-89f8658c7d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:56:42 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-3c95fec9-b821-4fc8-8f56-dbe17b4db57c tempest-VolumesTestJSON-308607296 None] Created volume successfully. Jun 16 08:56:42 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e" returned: 0 in 0.582s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:42 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-quobyte-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e" released by "delete_volume" :: held 1.331s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:42 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] Created reservations ['99654507-65f0-4604-92d1-319553abe93c', '4a3ceda4-4d39-430e-9dda-683ac21d0ec7', '965a42ab-db46-4881-a485-aba73fceb3eb', '0668e533-405a-4214-9a3d-b7b8d3203c7a'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:42 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:42 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:43 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.593s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:43 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:43 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] Deleted volume successfully. Jun 16 08:56:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-311127f1-0979-4ad7-88c5-2f1ce2a2697d tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-e2783fbc-0c4b-4e91-ab9e-7f205a4f402e-delete_volume" released by "delete_volume" :: held 2.106s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "cinder-ba041ef8-7226-4d91-8377-dc9200e2e363-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-ba041ef8-7226-4d91-8377-dc9200e2e363-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "cinder-quobyte-ba041ef8-7226-4d91-8377-dc9200e2e363" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-quobyte-ba041ef8-7226-4d91-8377-dc9200e2e363" acquired by "delete_volume" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:43 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36f8b3c-3aa1-40ba-9e55-0788776074e6]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ba041ef8-7226-4d91-8377-dc9200e2e363 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:43 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ba041ef8-7226-4d91-8377-dc9200e2e363 Jun 16 08:56:43 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] Acquiring lock "cinder-5875c9b4-6290-4828-9554-c8fa974f5ff2-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] Lock "cinder-5875c9b4-6290-4828-9554-c8fa974f5ff2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] Acquiring lock "cinder-quobyte-5875c9b4-6290-4828-9554-c8fa974f5ff2" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] Lock "cinder-quobyte-5875c9b4-6290-4828-9554-c8fa974f5ff2" acquired by "delete_volume" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:44 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ba041ef8-7226-4d91-8377-dc9200e2e363" returned: 0 in 0.758s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ba041ef8-7226-4d91-8377-dc9200e2e363 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cf3e48-edca-4a3e-9586-a1e5e820d0f6]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5875c9b4-6290-4828-9554-c8fa974f5ff2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:44 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ba041ef8-7226-4d91-8377-dc9200e2e363 Jun 16 08:56:44 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:44 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5875c9b4-6290-4828-9554-c8fa974f5ff2 Jun 16 08:56:44 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:44 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ba041ef8-7226-4d91-8377-dc9200e2e363" returned: 0 in 0.620s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-quobyte-ba041ef8-7226-4d91-8377-dc9200e2e363" released by "delete_volume" :: held 1.422s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] Created reservations ['839df9d3-a701-488a-b3e2-2fedfb7a2852', 'efbd437a-ded3-440b-8d66-4079fd046d22', '7fe486cf-ae65-4e3c-ab56-240f3b631f62', '7c27e2e3-9c92-41cd-a4bd-8ac385431334'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:44 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5875c9b4-6290-4828-9554-c8fa974f5ff2" returned: 0 in 0.699s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5875c9b4-6290-4828-9554-c8fa974f5ff2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:44 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5875c9b4-6290-4828-9554-c8fa974f5ff2 Jun 16 08:56:44 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:44 devstack sudo[108628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:44 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:45 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-5875c9b4-6290-4828-9554-c8fa974f5ff2" returned: 0 in 0.578s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] Lock "cinder-quobyte-5875c9b4-6290-4828-9554-c8fa974f5ff2" released by "delete_volume" :: held 1.331s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:45 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.595s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:45 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] Deleted volume successfully. Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] Created reservations ['42f4f349-310c-49a2-97ee-e0ee01f39143', 'c8978f1a-789b-4514-80b0-afd52a376b3d', '26354b34-b584-47e9-b5c5-a304e7b6d812', 'f18e035f-3048-4578-aa10-e851055e9eac'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-372eed80-3ed5-47ab-83cd-cc49e0e8ad38 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-ba041ef8-7226-4d91-8377-dc9200e2e363-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "cinder-9483c8c0-1f1e-487d-b14a-7e8e84131531-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-9483c8c0-1f1e-487d-b14a-7e8e84131531-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "cinder-quobyte-9483c8c0-1f1e-487d-b14a-7e8e84131531" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-quobyte-9483c8c0-1f1e-487d-b14a-7e8e84131531" acquired by "delete_volume" :: waited 0.033s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:45 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:45 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a79531d-2256-412c-8cbc-eb4686389aa1]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9483c8c0-1f1e-487d-b14a-7e8e84131531 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:45 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9483c8c0-1f1e-487d-b14a-7e8e84131531 Jun 16 08:56:45 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:46 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.587s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:46 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:46 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] Deleted volume successfully. Jun 16 08:56:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1e5a8a31-337d-4959-9d95-19ef4fbe01a7 tempest-VolumesTestJSON-308607296 None] Lock "cinder-5875c9b4-6290-4828-9554-c8fa974f5ff2-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] Acquiring lock "cinder-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] Lock "cinder-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] Acquiring lock "cinder-quobyte-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] Lock "cinder-quobyte-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:46 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ab428d-c202-4cca-a33d-f8047264bd63]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:46 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9483c8c0-1f1e-487d-b14a-7e8e84131531" returned: 0 in 0.743s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9483c8c0-1f1e-487d-b14a-7e8e84131531 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:46 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9483c8c0-1f1e-487d-b14a-7e8e84131531 Jun 16 08:56:46 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:46 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f Jun 16 08:56:46 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:46 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9483c8c0-1f1e-487d-b14a-7e8e84131531" returned: 0 in 0.602s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-quobyte-9483c8c0-1f1e-487d-b14a-7e8e84131531" released by "delete_volume" :: held 1.384s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:47 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] Created reservations ['19326b84-e044-44a6-93b5-472be85f5d95', '04990005-9a3c-489a-bec9-8b3646a30876', '9a825c70-9efa-4a34-9022-1b5cffb3c549', '436fe346-5d75-44ec-8501-c4c0d88bfcaf'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f" returned: 0 in 0.701s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:47 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f Jun 16 08:56:47 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:47 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:47 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:47 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f" returned: 0 in 0.598s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] Lock "cinder-quobyte-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f" released by "delete_volume" :: held 1.354s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:47 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.588s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:47 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] Deleted volume successfully. Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bbf95611-0043-4e22-a491-8798839ef39c tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-9483c8c0-1f1e-487d-b14a-7e8e84131531-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] Created reservations ['4beedcfa-54a7-4fdc-9017-16d96db29c7b', 'a9587481-95d4-4f2b-a9bc-9357730af15d', '294fa8b5-c213-41bc-94d1-ec8cb52e020d', '1a8ae7a6-87e1-4be8-8cdb-9c940f135a75'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "cinder-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "cinder-quobyte-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:47 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:47 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-quobyte-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d" acquired by "delete_volume" :: waited 0.020s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[042f724a-d299-467d-87a0-eac4b03684b4]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:47 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d Jun 16 08:56:47 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:48 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.593s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:48 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:48 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] Deleted volume successfully. Jun 16 08:56:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] Acquiring lock "cinder-4ed2d165-e3c1-4e96-9cb7-143ee98f6770-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c2b9d485-5d40-48c3-851a-3826a1319c8e tempest-VolumesTestJSON-308607296 None] Lock "cinder-d1e67ebf-d1e0-4069-b9ad-a490472ebe5f-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] Lock "cinder-4ed2d165-e3c1-4e96-9cb7-143ee98f6770-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] Acquiring lock "cinder-quobyte-4ed2d165-e3c1-4e96-9cb7-143ee98f6770" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] Lock "cinder-quobyte-4ed2d165-e3c1-4e96-9cb7-143ee98f6770" acquired by "delete_volume" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:48 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d11297-5b86-4f26-9c00-1661bb4fa7e7]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4ed2d165-e3c1-4e96-9cb7-143ee98f6770 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:48 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d" returned: 0 in 0.729s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:48 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d Jun 16 08:56:48 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:48 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4ed2d165-e3c1-4e96-9cb7-143ee98f6770 Jun 16 08:56:48 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:49 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d" returned: 0 in 0.603s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-quobyte-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d" released by "delete_volume" :: held 1.374s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] Created reservations ['0855c857-304c-4078-a679-eec8faf3c7fc', '29f04a07-f609-426f-991c-930015112f40', '16fca102-5154-4f0c-bade-83fe78fd0f4a', '367f1344-7c8a-4346-b194-df1b39cd2d26'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:49 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4ed2d165-e3c1-4e96-9cb7-143ee98f6770" returned: 0 in 0.735s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4ed2d165-e3c1-4e96-9cb7-143ee98f6770 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:49 devstack sudo[108672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4ed2d165-e3c1-4e96-9cb7-143ee98f6770 Jun 16 08:56:49 devstack sudo[108672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:49 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:49 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:49 devstack sudo[108672]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4ed2d165-e3c1-4e96-9cb7-143ee98f6770" returned: 0 in 0.585s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] Lock "cinder-quobyte-4ed2d165-e3c1-4e96-9cb7-143ee98f6770" released by "delete_volume" :: held 1.368s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:49 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.578s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:49 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] Deleted volume successfully. Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] Created reservations ['78997b8f-a42d-4c1b-8651-f3db312daaf5', '662f87b2-4d23-4fca-8c29-3529f68ab82e', '35e6233b-46bb-4063-8471-7c1374c8145a', 'f3c847e5-3475-450f-8035-cd8c8942802a'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-51f02f69-fe7d-4056-b161-b1d399e32c88 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-4dd0c25c-95c8-4ddf-ac87-4d0fdce66b8d-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "cinder-e98c07df-8b34-428c-a964-0624e927ba39-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:49 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-e98c07df-8b34-428c-a964-0624e927ba39-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "cinder-quobyte-e98c07df-8b34-428c-a964-0624e927ba39" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:50 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:50 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-quobyte-e98c07df-8b34-428c-a964-0624e927ba39" acquired by "delete_volume" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:50 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa30d0a-0fc8-41c6-adea-dea5aff82f0c]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e98c07df-8b34-428c-a964-0624e927ba39 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:50 devstack sudo[108680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e98c07df-8b34-428c-a964-0624e927ba39 Jun 16 08:56:50 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:50 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.588s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:50 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:50 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] Deleted volume successfully. Jun 16 08:56:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-279708b3-3450-40a9-92b9-93ce3d5e2ed3 tempest-VolumesTestJSON-308607296 None] Lock "cinder-4ed2d165-e3c1-4e96-9cb7-143ee98f6770-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:50 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e98c07df-8b34-428c-a964-0624e927ba39" returned: 0 in 0.717s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e98c07df-8b34-428c-a964-0624e927ba39 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:50 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e98c07df-8b34-428c-a964-0624e927ba39 Jun 16 08:56:50 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:51 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e98c07df-8b34-428c-a964-0624e927ba39" returned: 0 in 0.595s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:51 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-quobyte-e98c07df-8b34-428c-a964-0624e927ba39" released by "delete_volume" :: held 1.345s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:51 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] Created reservations ['2263ea3f-b29b-4766-9fc1-d5203e70f164', '0b5fd961-0002-47bc-b9bc-3e20beddc78e', 'ebac787d-9c31-4639-ace2-3a019da7f3e6', '9b3720f6-c597-409e-8c68-af8e88399581'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:51 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:51 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:52 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.648s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:52 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:52 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] Deleted volume successfully. Jun 16 08:56:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "cinder-5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-71747563-cd78-4e75-a5a1-a021d42faea4 tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-e98c07df-8b34-428c-a964-0624e927ba39-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "cinder-quobyte-92517f5a-2d44-4912-b59a-3258c84ab4da" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-quobyte-92517f5a-2d44-4912-b59a-3258c84ab4da" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "cinder-quobyte-5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-quobyte-5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:52 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] Deleting offline snapshot 5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab of volume 92517f5a-2d44-4912-b59a-3258c84ab4da {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:56:52 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] snapshot_file for this snap is: volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:56:52 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c69c7b5-d938-4c92-824d-99a472d22238]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:52 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab Jun 16 08:56:52 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:52 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab" returned: 0 in 0.699s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:52 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92517f5a-2d44-4912-b59a-3258c84ab4da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:56:53 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b1ef02-c360-485a-9ad1-8cd514c4804f]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:53 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da Jun 16 08:56:53 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:53 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da" returned: 0 in 0.723s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:53 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab Jun 16 08:56:53 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:54 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab" returned: 0 in 0.686s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:54 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab Jun 16 08:56:54 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:55 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da.5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab" returned: 0 in 0.606s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-quobyte-5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab" released by "_delete_snapshot" :: held 2.818s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-quobyte-92517f5a-2d44-4912-b59a-3258c84ab4da" released by "delete_snapshot" :: held 2.841s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:55 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] Created reservations ['bc1ca7a3-d6b3-46e4-a531-3969cc875a98', '6b5ad10b-76cc-4713-8f67-447a5fd595fd', '7a9af677-6f8b-4dae-a0dd-9363ce68a978', '1fea7e60-133a-413f-b436-116a7095815a'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:55 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] Delete snapshot completed successfully. Jun 16 08:56:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-665f350f-1a2d-4947-a3eb-37c7891dedce tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-5b76c3d3-c815-49a0-8d9d-57d9a8fc85ab-delete_snapshot" released by "delete_snapshot" :: held 3.013s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "cinder-92517f5a-2d44-4912-b59a-3258c84ab4da-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-92517f5a-2d44-4912-b59a-3258c84ab4da-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "cinder-quobyte-92517f5a-2d44-4912-b59a-3258c84ab4da" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:56:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-quobyte-92517f5a-2d44-4912-b59a-3258c84ab4da" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:56:55 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[966364e3-740e-4e86-9ab8-19dc67db1617]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:56:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:55 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da Jun 16 08:56:55 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:56 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da" returned: 0 in 0.702s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:56 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da Jun 16 08:56:56 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:56 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-92517f5a-2d44-4912-b59a-3258c84ab4da" returned: 0 in 0.576s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-quobyte-92517f5a-2d44-4912-b59a-3258c84ab4da" released by "delete_volume" :: held 1.334s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:56 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] Created reservations ['9edc9188-5f1f-4065-8df6-7fb8e7b66ad9', '68bff160-e218-47d3-a961-8cb6e0e1fa97', '60cd7020-847d-4ea9-afc0-900d07705d0a', 'fffdf2ee-37d9-4753-924d-154de149afb6'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:56:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:56:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:56:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:56:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:56:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:56:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:56:56 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:56:56 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:56:57 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Jun 16 08:56:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.573s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:56:57 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:56:57 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] Deleted volume successfully. Jun 16 08:56:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-412c1805-0214-4cb5-9e38-7ab183b5ddcb tempest-CreateVolumesFromSnapshotTest-822115443 None] Lock "cinder-92517f5a-2d44-4912-b59a-3258c84ab4da-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:56:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2363a695-e251-4026-a391-50b2b148b8b5 tempest-BackendsCapabilitiesAdminTestsJSON-55973984 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578506469727, 'free_capacity_gb': 1775.7578506469727, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92348) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 16 08:56:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-510298a3-765b-4bb1-9832-65d5453e4b38 tempest-BackendsCapabilitiesAdminTestsJSON-55973984 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578506469727, 'free_capacity_gb': 1775.7578506469727, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92348) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 16 08:57:02 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:57:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Flow 'volume_create_manager' (6bcfe285-3efd-464b-848b-9eacdbc0fb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:57:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010910c7-4960-4396-8408-595a23126afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010910c7-4960-4396-8408-595a23126afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22337c4-c758-4004-aef3-3753cb62e1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6913472dc4394b1dbb38a322f5b8c4b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:57:03Z,use_quota=True,user_id='9ea15de160ce40859fba873420e279e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85850a36-8d63-459b-843d-54383d2e4bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85850a36-8d63-459b-843d-54383d2e4bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:02 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ea597f-ada5-4974-ad2f-1c39cf3d4103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:02 devstack cinder-volume[92348]: DEBUG cinder.image.glance [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Creating Keystone auth plugin from conf {{(pid=92348) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 16 08:57:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ea597f-ada5-4974-ad2f-1c39cf3d4103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b22337c4-c758-4004-aef3-3753cb62e1cc', 'volume_name': 'volume-b22337c4-c758-4004-aef3-3753cb62e1cc', 'volume_size': 1, 'image_id': '5747b123-c5d2-42f0-9b2a-88ffefa7e2a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5747b123-c5d2-42f0-9b2a-88ffefa7e2a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c49d7d6c73ad849cc4c8cf8b8c1ef47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6913472dc4394b1dbb38a322f5b8c4b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '270f9c679b2b728feb4a44b31841f6cf50fe2c88d71e59a906ee0818e9603ba96e5d2050d90cecede8f1c332a6aa6e1ec1acceeb50fdf04cd1da2a1955b763da', 'id': '5747b123-c5d2-42f0-9b2a-88ffefa7e2a4', 'created_at': datetime.datetime(2026, 6, 16, 6, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 57, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5747b123-c5d2-42f0-9b2a-88ffefa7e2a4/file', 'properties': {}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec34cf8-e7c7-488c-bf07-95692e7a85ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec34cf8-e7c7-488c-bf07-95692e7a85ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:03 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55d31ee-7346-4a73-8802-52dba45d8a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:03 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Volume b22337c4-c758-4004-aef3-3753cb62e1cc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b22337c4-c758-4004-aef3-3753cb62e1cc', 'volume_size': 1, 'image_id': '5747b123-c5d2-42f0-9b2a-88ffefa7e2a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5747b123-c5d2-42f0-9b2a-88ffefa7e2a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c49d7d6c73ad849cc4c8cf8b8c1ef47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6913472dc4394b1dbb38a322f5b8c4b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '270f9c679b2b728feb4a44b31841f6cf50fe2c88d71e59a906ee0818e9603ba96e5d2050d90cecede8f1c332a6aa6e1ec1acceeb50fdf04cd1da2a1955b763da', 'id': '5747b123-c5d2-42f0-9b2a-88ffefa7e2a4', 'created_at': datetime.datetime(2026, 6, 16, 6, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 57, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5747b123-c5d2-42f0-9b2a-88ffefa7e2a4/file', 'properties': {}}, 'image_service': } Jun 16 08:57:03 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Trying to clone b22337c4-c758-4004-aef3-3753cb62e1cc from image 5747b123-c5d2-42f0-9b2a-88ffefa7e2a4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5747b123-c5d2-42f0-9b2a-88ffefa7e2a4', 'metadata': {}}]). {{(pid=92348) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 16 08:57:03 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 16 08:57:03 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Image download 0.00 MB at 0.00 MB/s Jun 16 08:57:03 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[61447665-0a35-4a15-b594-c6b5966b588d]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:03 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD Jun 16 08:57:03 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:03 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-19914e4a-af6f-48fe-81d8-3d1409a30cb6 tempest-GroupSnapshotsTest-1487623336 None] Group tempest-GroupSnapshotsTest-Group-1477710312: creating Jun 16 08:57:03 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-19914e4a-af6f-48fe-81d8-3d1409a30cb6 tempest-GroupSnapshotsTest-1487623336 None] Group tempest-GroupSnapshotsTest-Group-1477710312: created successfully Jun 16 08:57:03 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-19914e4a-af6f-48fe-81d8-3d1409a30cb6 tempest-GroupSnapshotsTest-1487623336 None] Create group completed successfully. Jun 16 08:57:04 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD" returned: 0 in 0.675s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:04 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD Jun 16 08:57:04 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:04 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD" returned: 1 in 0.649s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:57:04 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Temporary image 5747b123-c5d2-42f0-9b2a-88ffefa7e2a4 is fetched for user 9ea15de160ce40859fba873420e279e0. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 16 08:57:04 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eab00ee-e8de-4d2a-b35a-8ccf12f68cb4]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:05 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD Jun 16 08:57:05 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Flow 'volume_create_manager' (88720eec-5d26-4c80-a6c4-b4a425b5dbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377f8a03-2313-49c8-94cb-139abf5b5c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377f8a03-2313-49c8-94cb-139abf5b5c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-542323125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d8fef7aa-e152-4483-8a57-ecdbbf6fbc95,host='devstack@QuobyteHD#QuobyteHD',id=60c66ae0-21d9-42bd-96ae-a33cb57bb2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b5b08fc94f422885eaed5f5c7129af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:57:05Z,use_quota=True,user_id='148d601374dc45aaac35c3d0ca531b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b6fcf9d-0236-4a0c-8b16-7488195b5d41),volume_type_id=8b6fcf9d-0236-4a0c-8b16-7488195b5d41)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda3b780-ef2b-4a8e-accb-baf1e8ee8225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda3b780-ef2b-4a8e-accb-baf1e8ee8225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181a239f-c471-4852-8ca1-efc3514893ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181a239f-c471-4852-8ca1-efc3514893ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c66ae0-21d9-42bd-96ae-a33cb57bb2f1', 'volume_name': 'volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e285376b-97b5-493b-9903-71b1d079572b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e285376b-97b5-493b-9903-71b1d079572b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f203e1-abb5-4a8c-84d7-b4abca1ce21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:05 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Volume 60c66ae0-21d9-42bd-96ae-a33cb57bb2f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1', 'volume_size': 1} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d8fef7aa-e152-4483-8a57-ecdbbf6fbc95,created_at=2026-06-16T06:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-542323125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d8fef7aa-e152-4483-8a57-ecdbbf6fbc95,host='devstack@QuobyteHD#QuobyteHD',id=60c66ae0-21d9-42bd-96ae-a33cb57bb2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b5b08fc94f422885eaed5f5c7129af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:57:05Z,use_quota=True,user_id='148d601374dc45aaac35c3d0ca531b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b6fcf9d-0236-4a0c-8b16-7488195b5d41),volume_type_id=8b6fcf9d-0236-4a0c-8b16-7488195b5d41)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Creating volume 60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:57:05 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:05 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 1073741824 Jun 16 08:57:05 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:05 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD" returned: 0 in 0.671s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:05 devstack sudo[108746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD Jun 16 08:57:05 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:06 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 1073741824" returned: 0 in 0.799s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:06 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 Jun 16 08:57:06 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:06 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD" returned: 1 in 0.716s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:06 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1" returned: 0 in 0.601s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.388s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22337c4-c758-4004-aef3-3753cb62e1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6913472dc4394b1dbb38a322f5b8c4b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:57:03Z,use_quota=True,user_id='9ea15de160ce40859fba873420e279e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Creating volume b22337c4-c758-4004-aef3-3753cb62e1cc {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:57:06 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f203e1-abb5-4a8c-84d7-b4abca1ce21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:06 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc 1073741824 Jun 16 08:57:06 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11e539e-c1ab-46af-b289-2857819f954a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:06 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Volume volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 (60c66ae0-21d9-42bd-96ae-a33cb57bb2f1): created successfully Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11e539e-c1ab-46af-b289-2857819f954a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Flow 'volume_create_manager' (88720eec-5d26-4c80-a6c4-b4a425b5dbdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:57:06 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ae3599b9-267e-4251-a582-aaff6690a464 tempest-GroupSnapshotsTest-1487623336 None] Created volume successfully. Jun 16 08:57:07 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc 1073741824" returned: 0 in 0.758s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:07 devstack sudo[108764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc Jun 16 08:57:07 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:07 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] GroupSnapshot d569e21f-0b43-4548-915e-3f2406f6bd8b: creating. Jun 16 08:57:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] Group snapshot d569e21f-0b43-4548-915e-3f2406f6bd8b: creating. {{(pid=92348) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 16 08:57:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:08 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc" returned: 0 in 0.642s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:08 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:57:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.526s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:08 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] Creating offline snapshot da4f888c-a93e-4b75-9169-b6f85438d4dc of volume 60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:57:08 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8393c5eb-10b1-4b80-9d01-053e5c2c5f80]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:08 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Attempting download of 5747b123-c5d2-42f0-9b2a-88ffefa7e2a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5747b123-c5d2-42f0-9b2a-88ffefa7e2a4', 'metadata': {}}])) to volume b22337c4-c758-4004-aef3-3753cb62e1cc. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 16 08:57:08 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3431890-7a34-4826-acdf-5ae477725f3b]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_xxzz3lpi {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:08 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 Jun 16 08:57:08 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:08 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_xxzz3lpi Jun 16 08:57:08 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:08 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1" returned: 0 in 0.707s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:08 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc 1G Jun 16 08:57:08 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:08 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_xxzz3lpi" returned: 0 in 0.680s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_xxzz3lpi {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:09 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_xxzz3lpi Jun 16 08:57:09 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:09 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_xxzz3lpi" returned: 1 in 0.669s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_xxzz3lpi' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:57:09 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07eb201-5ac7-4228-8b03-767af51b3c59]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:09 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc 1G" returned: 0 in 0.798s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:09 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD Jun 16 08:57:09 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:09 devstack sudo[108824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc Jun 16 08:57:09 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:10 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD" returned: 0 in 0.660s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:10 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc" returned: 0 in 0.640s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:10 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc is being set with open permissions: ugo+rw: NotImplementedError Jun 16 08:57:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:10 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc Jun 16 08:57:10 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:10 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD Jun 16 08:57:10 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:10 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc" returned: 0 in 0.573s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:10 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:10 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=126,cinder:UPDATE=174,cinder:INSERT=43,cinder:DELETE=16 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:57:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD" returned: 1 in 0.666s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:57:10 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] 5747b123-c5d2-42f0-9b2a-88ffefa7e2a4 was raw, converting to raw {{(pid=92348) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 16 08:57:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:10 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc Jun 16 08:57:10 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:10 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.info Jun 16 08:57:10 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:11 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.info" returned: 0 in 0.597s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:11 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.info is being set with open permissions: ugo+rw: NotImplementedError Jun 16 08:57:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:11 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.info Jun 16 08:57:11 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:11 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc" returned: 0 in 0.667s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:11 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5747b123-c5d2-42f0-9b2a-88ffefa7e2a4_5gz3k_b8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:57:11 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Converted 0.00 MB image at 0.00 MB/s Jun 16 08:57:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:11 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc 1G Jun 16 08:57:11 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:12 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.info" returned: 0 in 0.570s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.984s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:12 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-efe1130f-9022-45ca-9a89-80cf90911738 tempest-GroupSnapshotsTest-1487623336 None] group_snapshot d569e21f-0b43-4548-915e-3f2406f6bd8b: created successfully Jun 16 08:57:12 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc 1G" returned: 0 in 0.612s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:12 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28cc6c6-1d44-47bf-aba7-e43e45d94f2f]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:12 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc Jun 16 08:57:12 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:12 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc" returned: 0 in 0.694s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:13 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc Jun 16 08:57:13 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:13 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc" returned: 1 in 0.692s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Downloaded image 5747b123-c5d2-42f0-9b2a-88ffefa7e2a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5747b123-c5d2-42f0-9b2a-88ffefa7e2a4', 'metadata': {}}])) to volume b22337c4-c758-4004-aef3-3753cb62e1cc successfully. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Temporary image 5747b123-c5d2-42f0-9b2a-88ffefa7e2a4 for user 9ea15de160ce40859fba873420e279e0 is deleted. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Marking volume b22337c4-c758-4004-aef3-3753cb62e1cc as bootable. {{(pid=92348) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Copying metadata from image 5747b123-c5d2-42f0-9b2a-88ffefa7e2a4 to b22337c4-c758-4004-aef3-3753cb62e1cc. {{(pid=92348) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Creating volume glance metadata for volume b22337c4-c758-4004-aef3-3753cb62e1cc backed by image 5747b123-c5d2-42f0-9b2a-88ffefa7e2a4 with: {'image_id': '5747b123-c5d2-42f0-9b2a-88ffefa7e2a4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9c49d7d6c73ad849cc4c8cf8b8c1ef47', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92348) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55d31ee-7346-4a73-8802-52dba45d8a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b22337c4-c758-4004-aef3-3753cb62e1cc', 'volume_size': 1, 'image_id': '5747b123-c5d2-42f0-9b2a-88ffefa7e2a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5747b123-c5d2-42f0-9b2a-88ffefa7e2a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c49d7d6c73ad849cc4c8cf8b8c1ef47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6913472dc4394b1dbb38a322f5b8c4b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '270f9c679b2b728feb4a44b31841f6cf50fe2c88d71e59a906ee0818e9603ba96e5d2050d90cecede8f1c332a6aa6e1ec1acceeb50fdf04cd1da2a1955b763da', 'id': '5747b123-c5d2-42f0-9b2a-88ffefa7e2a4', 'created_at': datetime.datetime(2026, 6, 16, 6, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 6, 57, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5747b123-c5d2-42f0-9b2a-88ffefa7e2a4/file', 'properties': {}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a0f420-68a9-44f7-8cf6-6dc7dbbdf024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:13 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Volume volume-b22337c4-c758-4004-aef3-3753cb62e1cc (b22337c4-c758-4004-aef3-3753cb62e1cc): created successfully Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a0f420-68a9-44f7-8cf6-6dc7dbbdf024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Flow 'volume_create_manager' (6bcfe285-3efd-464b-848b-9eacdbc0fb7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:57:13 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-a442d271-5b6d-4121-9869-e28cf94a2afb tempest-VolumeImageDependencyTests-380775453 None] Created volume successfully. Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "cinder-quobyte-da4f888c-a93e-4b75-9169-b6f85438d4dc-dc597634-a399-4a60-9bf4-7a593eefb7dc" by "_create_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-da4f888c-a93e-4b75-9169-b6f85438d4dc-dc597634-a399-4a60-9bf4-7a593eefb7dc" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Creating volume dc597634-a399-4a60-9bf4-7a593eefb7dc from snapshot da4f888c-a93e-4b75-9169-b6f85438d4dc {{(pid=92348) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "cinder-quobyte-dc597634-a399-4a60-9bf4-7a593eefb7dc" by "_copy_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-dc597634-a399-4a60-9bf4-7a593eefb7dc" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] snapshot: da4f888c-a93e-4b75-9169-b6f85438d4dc, volume: dc597634-a399-4a60-9bf4-7a593eefb7dc, {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:57:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:14 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c75edc1-a512-432b-8678-1948dddd882b]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:14 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc Jun 16 08:57:14 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Acquiring lock "cinder-b22337c4-c758-4004-aef3-3753cb62e1cc-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:57:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Lock "cinder-b22337c4-c758-4004-aef3-3753cb62e1cc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:57:14 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:INSERT=46,cinder:UPDATE=173,cinder:SELECT=121,cinder:DELETE=11 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:57:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Acquiring lock "cinder-quobyte-b22337c4-c758-4004-aef3-3753cb62e1cc" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:57:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Lock "cinder-quobyte-b22337c4-c758-4004-aef3-3753cb62e1cc" acquired by "delete_volume" :: waited 0.023s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:57:14 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4029086c-fafd-4c2f-93fc-e45059a76ae2]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:14 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc" returned: 0 in 0.718s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:14 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:57:14 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 16 08:57:14 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Creating direct copy from snapshot {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 16 08:57:14 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baac41b-72ee-4e8a-a47c-eaccd9f33ce3]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:14 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc Jun 16 08:57:14 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:14 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 Jun 16 08:57:14 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:15 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc" returned: 0 in 0.723s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:15 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1" returned: 0 in 0.713s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:15 devstack cinder-volume[92348]: DEBUG cinder.utils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Path /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dc597634-a399-4a60-9bf4-7a593eefb7dc not found in is_blk_device check {{(pid=92348) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 16 08:57:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dc597634-a399-4a60-9bf4-7a593eefb7dc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:15 devstack sudo[108881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dc597634-a399-4a60-9bf4-7a593eefb7dc Jun 16 08:57:15 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:15 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc Jun 16 08:57:15 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:16 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc" returned: 1 in 0.686s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 08:57:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:16 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc Jun 16 08:57:16 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:17 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b22337c4-c758-4004-aef3-3753cb62e1cc" returned: 0 in 1.004s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Lock "cinder-quobyte-b22337c4-c758-4004-aef3-3753cb62e1cc" released by "delete_volume" :: held 2.499s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:57:17 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Created reservations ['72aa826c-292f-4aa4-a8a4-1aa9a2435531', '8f92fd28-a257-4eca-a423-f838bc5112f5', '0b33843e-fb72-4560-b903-136dfbf0e061', 'c47ec570-3dd7-4bf7-8a9c-6f211f473aad'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:57:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:17 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:57:17 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:57:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:17 devstack sudo[108900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:57:17 devstack sudo[108900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:18 devstack sudo[108900]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.987s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:18 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:57:18 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Deleted volume successfully. Jun 16 08:57:18 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-06d20a93-2b59-42f7-b901-7e1d284cff02 tempest-VolumeImageDependencyTests-380775453 None] Lock "cinder-b22337c4-c758-4004-aef3-3753cb62e1cc-delete_volume" released by "delete_volume" :: held 3.914s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:57:20 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dc597634-a399-4a60-9bf4-7a593eefb7dc" returned: 0 in 5.223s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:20 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[58495936-dd15-4bc6-95e1-fc5266989698]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:20 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 Jun 16 08:57:20 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:21 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1" returned: 0 in 0.862s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:21 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dc597634-a399-4a60-9bf4-7a593eefb7dc {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:57:21 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Converted 1024.00 MB image at 196.03 MB/s Jun 16 08:57:21 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dc597634-a399-4a60-9bf4-7a593eefb7dc is being set with open permissions: ugo+rw: NotImplementedError Jun 16 08:57:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dc597634-a399-4a60-9bf4-7a593eefb7dc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:21 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dc597634-a399-4a60-9bf4-7a593eefb7dc Jun 16 08:57:21 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:22 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dc597634-a399-4a60-9bf4-7a593eefb7dc" returned: 0 in 0.592s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-dc597634-a399-4a60-9bf4-7a593eefb7dc" released by "_copy_volume_from_snapshot" :: held 8.222s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:57:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-da4f888c-a93e-4b75-9169-b6f85438d4dc-dc597634-a399-4a60-9bf4-7a593eefb7dc" released by "_create_volume_from_snapshot" :: held 8.258s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:57:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.280s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:22 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-6fdcb891-d0aa-4e2e-853c-45b0add03610 tempest-GroupSnapshotsTest-1487623336 None] Create group from source-snapshot-d569e21f-0b43-4548-915e-3f2406f6bd8b completed successfully. Jun 16 08:57:23 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "cinder-quobyte-dc597634-a399-4a60-9bf4-7a593eefb7dc" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:57:23 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-dc597634-a399-4a60-9bf4-7a593eefb7dc" acquired by "delete_volume" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:57:23 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9904c23-5438-4155-8fe3-f7f10851f65c]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dc597634-a399-4a60-9bf4-7a593eefb7dc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:23 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dc597634-a399-4a60-9bf4-7a593eefb7dc Jun 16 08:57:23 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:24 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dc597634-a399-4a60-9bf4-7a593eefb7dc" returned: 0 in 0.753s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dc597634-a399-4a60-9bf4-7a593eefb7dc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:24 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dc597634-a399-4a60-9bf4-7a593eefb7dc Jun 16 08:57:24 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:25 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-dc597634-a399-4a60-9bf4-7a593eefb7dc" returned: 0 in 0.610s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-dc597634-a399-4a60-9bf4-7a593eefb7dc" released by "delete_volume" :: held 1.421s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:57:25 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] Created reservations ['a93ae470-dcff-4522-9e35-2b517ac5d91f'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:57:25 devstack cinder-volume[92348]: WARNING cinder.quota [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-273539788 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-273539788, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:57:25 devstack cinder-volume[92348]: WARNING cinder.quota [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-273539788 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-273539788, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:57:25 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] Created reservations ['90970fe0-d8fd-4a3b-9545-5a2a89352ac9', 'b0f29de6-6de5-4c22-9ecd-f27c41beae2d', 'ee154cc9-27dd-4cd5-aead-f59d357f847d', '08e1108b-b5d5-47b1-9239-5c66df0eb635'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:57:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:57:25 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:57:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:25 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:57:25 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:25 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.621s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:25 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:57:25 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c9083fa6-2337-4c8f-a3dd-3d7ee1fd02e1 tempest-GroupSnapshotsTest-1487623336 None] Delete group completed successfully. Jun 16 08:57:25 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] group_snapshot d569e21f-0b43-4548-915e-3f2406f6bd8b: deleting Jun 16 08:57:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] group_snapshot d569e21f-0b43-4548-915e-3f2406f6bd8b: deleting {{(pid=92348) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 16 08:57:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "cinder-quobyte-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:57:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:57:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "cinder-quobyte-da4f888c-a93e-4b75-9169-b6f85438d4dc" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:57:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-da4f888c-a93e-4b75-9169-b6f85438d4dc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:57:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] Deleting offline snapshot da4f888c-a93e-4b75-9169-b6f85438d4dc of volume 60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:57:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] snapshot_file for this snap is: volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:57:26 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[225b8ec7-2afb-4c6e-8701-619695753dbd]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:26 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc Jun 16 08:57:26 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:26 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc" returned: 0 in 0.801s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:57:26 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0f03d1-f1f0-4a04-b1f8-fcfa67818289]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:27 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 Jun 16 08:57:27 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:27 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1" returned: 0 in 0.727s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:27 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc Jun 16 08:57:27 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:28 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc" returned: 0 in 0.741s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:28 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc Jun 16 08:57:28 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:29 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1.da4f888c-a93e-4b75-9169-b6f85438d4dc" returned: 0 in 0.667s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-da4f888c-a93e-4b75-9169-b6f85438d4dc" released by "_delete_snapshot" :: held 3.065s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:57:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1" released by "delete_snapshot" :: held 3.091s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:57:29 devstack cinder-volume[92348]: WARNING cinder.quota [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-273539788 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-273539788, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:57:29 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] Created reservations ['d4a3e61e-4f2d-4ef5-b0e2-a563d818354d', '2e584226-f5f2-492a-acf9-6d6212bd8b9d', '0f6bba8a-00af-40a4-9820-74cc9e580b47', '38aae657-2cb1-40c3-8f48-898c05623db0'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:57:29 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-40b093b2-66df-4d42-b840-bd27672b8e26 tempest-GroupSnapshotsTest-1487623336 None] group_snapshot d569e21f-0b43-4548-915e-3f2406f6bd8b: deleted successfully Jun 16 08:57:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:57:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:57:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:57:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:30 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:57:30 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "cinder-quobyte-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:57:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1" acquired by "delete_volume" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:57:30 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e007f7e-9b1a-4f34-a076-a59d8a00785c]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:30 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 Jun 16 08:57:30 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:30 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.781s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:30 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:57:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:57:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:57:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:57:31 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1" returned: 0 in 0.908s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:31 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1 Jun 16 08:57:31 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:32 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1" returned: 0 in 0.643s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-60c66ae0-21d9-42bd-96ae-a33cb57bb2f1" released by "delete_volume" :: held 1.649s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:57:32 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] Created reservations ['cf66f803-17c6-45b9-bedf-c46a12b2e711'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:57:32 devstack cinder-volume[92348]: WARNING cinder.db.sqlalchemy.api [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-273539788'] Jun 16 08:57:32 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] Created reservations ['baf497c2-fd80-4602-9be8-fcba735f60a9', '54cc6605-269f-44f6-96ef-00be0f976485', '70ddbd2c-da94-4b9f-b34b-7fc68ec9e596', '8b343c4c-f4e9-4dbc-b056-8c20b54bccec'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:57:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:57:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:57:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:32 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:57:32 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:33 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.629s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:33 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:57:33 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-6b3f4191-53d7-4b51-a7a6-5d454b162dd7 tempest-GroupSnapshotsTest-1487623336 None] Delete group completed successfully. Jun 16 08:57:33 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-00e9e6ba-766b-419d-9ac4-2c87e791e54e tempest-GroupSnapshotsTest-1487623336 None] Group tempest-GroupSnapshotsTest-Group-1255829104: creating Jun 16 08:57:33 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-00e9e6ba-766b-419d-9ac4-2c87e791e54e tempest-GroupSnapshotsTest-1487623336 None] Group tempest-GroupSnapshotsTest-Group-1255829104: created successfully Jun 16 08:57:33 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-00e9e6ba-766b-419d-9ac4-2c87e791e54e tempest-GroupSnapshotsTest-1487623336 None] Create group completed successfully. Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Flow 'volume_create_manager' (fd30795e-9822-489d-b71a-60bda7eb68b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4671ffe2-3a35-49e8-90db-01cdb08fbb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4671ffe2-3a35-49e8-90db-01cdb08fbb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2056201983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7103f55-b965-475e-ade6-50106d8b7f99,host='devstack@QuobyteHD#QuobyteHD',id=3f1a7fa8-e522-4a5f-9e06-b491f019ee39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b5b08fc94f422885eaed5f5c7129af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:57:35Z,use_quota=True,user_id='148d601374dc45aaac35c3d0ca531b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecd5d073-30b1-416a-901a-2c6031d02b00),volume_type_id=ecd5d073-30b1-416a-901a-2c6031d02b00)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3201987-d76f-4d69-8911-4e4ec539349a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3201987-d76f-4d69-8911-4e4ec539349a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a45389c-3823-435b-9f77-73ee363e10d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a45389c-3823-435b-9f77-73ee363e10d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f1a7fa8-e522-4a5f-9e06-b491f019ee39', 'volume_name': 'volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f371c1a-a348-4a54-883f-af831f2bbe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f371c1a-a348-4a54-883f-af831f2bbe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9420feb-612b-4676-9d95-7599f7e2bb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:34 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Volume 3f1a7fa8-e522-4a5f-9e06-b491f019ee39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39', 'volume_size': 1} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7103f55-b965-475e-ade6-50106d8b7f99,created_at=2026-06-16T06:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2056201983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7103f55-b965-475e-ade6-50106d8b7f99,host='devstack@QuobyteHD#QuobyteHD',id=3f1a7fa8-e522-4a5f-9e06-b491f019ee39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b5b08fc94f422885eaed5f5c7129af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:57:35Z,use_quota=True,user_id='148d601374dc45aaac35c3d0ca531b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecd5d073-30b1-416a-901a-2c6031d02b00),volume_type_id=ecd5d073-30b1-416a-901a-2c6031d02b00)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Creating volume 3f1a7fa8-e522-4a5f-9e06-b491f019ee39 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:57:34 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:57:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:34 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39 1073741824 Jun 16 08:57:34 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:35 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39 1073741824" returned: 0 in 0.786s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:35 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39 Jun 16 08:57:35 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:36 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39" returned: 0 in 0.664s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:57:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9420feb-612b-4676-9d95-7599f7e2bb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c677c4fd-b4b1-4a51-976b-3ac7c269f28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:36 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Volume volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39 (3f1a7fa8-e522-4a5f-9e06-b491f019ee39): created successfully Jun 16 08:57:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c677c4fd-b4b1-4a51-976b-3ac7c269f28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Flow 'volume_create_manager' (fd30795e-9822-489d-b71a-60bda7eb68b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:57:36 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-373ea383-45f2-41f4-96eb-d83bd9d8b212 tempest-GroupSnapshotsTest-1487623336 None] Created volume successfully. Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Flow 'volume_create_manager' (314c06fc-79b2-4cbe-b661-391eb740c057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22167c38-db02-4aa1-9b46-e73d05eb23de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22167c38-db02-4aa1-9b46-e73d05eb23de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-382480701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7103f55-b965-475e-ade6-50106d8b7f99,host='devstack@QuobyteHD#QuobyteHD',id=fe41aab4-ac64-4618-b642-72ff870aa0df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b5b08fc94f422885eaed5f5c7129af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:57:37Z,use_quota=True,user_id='148d601374dc45aaac35c3d0ca531b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecd5d073-30b1-416a-901a-2c6031d02b00),volume_type_id=ecd5d073-30b1-416a-901a-2c6031d02b00)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6306649d-b928-4635-aa28-9b448425ca89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6306649d-b928-4635-aa28-9b448425ca89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1efa362b-7078-4832-8005-8a5c926ef169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1efa362b-7078-4832-8005-8a5c926ef169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe41aab4-ac64-4618-b642-72ff870aa0df', 'volume_name': 'volume-fe41aab4-ac64-4618-b642-72ff870aa0df', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd873b6c-168e-42f3-9959-631c77f9f8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd873b6c-168e-42f3-9959-631c77f9f8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0402eeb-0def-4d67-8bde-1229631a815d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:37 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Volume fe41aab4-ac64-4618-b642-72ff870aa0df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe41aab4-ac64-4618-b642-72ff870aa0df', 'volume_size': 1} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7103f55-b965-475e-ade6-50106d8b7f99,created_at=2026-06-16T06:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-382480701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7103f55-b965-475e-ade6-50106d8b7f99,host='devstack@QuobyteHD#QuobyteHD',id=fe41aab4-ac64-4618-b642-72ff870aa0df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b5b08fc94f422885eaed5f5c7129af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:57:37Z,use_quota=True,user_id='148d601374dc45aaac35c3d0ca531b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecd5d073-30b1-416a-901a-2c6031d02b00),volume_type_id=ecd5d073-30b1-416a-901a-2c6031d02b00)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Creating volume fe41aab4-ac64-4618-b642-72ff870aa0df {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:57:37 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:57:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:37 devstack sudo[108974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df 1073741824 Jun 16 08:57:37 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:38 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df 1073741824" returned: 0 in 0.852s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:38 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df Jun 16 08:57:38 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:39 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df" returned: 0 in 0.646s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:57:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0402eeb-0def-4d67-8bde-1229631a815d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe41aab4-ac64-4618-b642-72ff870aa0df', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935ba349-d18d-46ce-915a-047309617d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:39 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Volume volume-fe41aab4-ac64-4618-b642-72ff870aa0df (fe41aab4-ac64-4618-b642-72ff870aa0df): created successfully Jun 16 08:57:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935ba349-d18d-46ce-915a-047309617d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Flow 'volume_create_manager' (314c06fc-79b2-4cbe-b661-391eb740c057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:57:39 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ba1086a1-a82f-4e8d-9b73-066937407def tempest-GroupSnapshotsTest-1487623336 None] Created volume successfully. Jun 16 08:57:39 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4dddf2b7-d6b9-4591-aad9-97b3e9211bbf tempest-GroupSnapshotsTest-1487623336 None] Update group completed successfully. Jun 16 08:57:40 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-0b97080f-3074-4fad-9751-fd39cbd8ed3f tempest-GroupSnapshotsTest-1487623336 None] Update group completed successfully. Jun 16 08:57:42 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-1b532013-073e-4178-9479-f212aca05af1 tempest-GroupSnapshotsTest-1487623336 None] Update group completed successfully. Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Flow 'volume_create_manager' (29627770-4b7b-4ea1-8522-90cdde81e2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fea6cbf-8917-4390-b017-588e022f81e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fea6cbf-8917-4390-b017-588e022f81e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1382568527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95149f44-6128-4718-88dc-c7688b02d308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce64d028647e45378b536615c46d7003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:57:43Z,use_quota=True,user_id='8c5244cd9819406385bf081e979d6788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec536ae-9b46-4446-9e84-190310ba8da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec536ae-9b46-4446-9e84-190310ba8da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872f2e14-3753-4c7e-b2a9-fecffa492331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872f2e14-3753-4c7e-b2a9-fecffa492331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95149f44-6128-4718-88dc-c7688b02d308', 'volume_name': 'volume-95149f44-6128-4718-88dc-c7688b02d308', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb70f9a9-2b7f-4c2c-b5c2-77921ebe0b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb70f9a9-2b7f-4c2c-b5c2-77921ebe0b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8276427e-560b-4504-b8c1-6c4cc8f29ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:43 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Volume 95149f44-6128-4718-88dc-c7688b02d308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95149f44-6128-4718-88dc-c7688b02d308', 'volume_size': 1} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1382568527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95149f44-6128-4718-88dc-c7688b02d308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce64d028647e45378b536615c46d7003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:57:43Z,use_quota=True,user_id='8c5244cd9819406385bf081e979d6788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Creating volume 95149f44-6128-4718-88dc-c7688b02d308 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:57:43 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:57:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:43 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 1073741824 Jun 16 08:57:43 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:43 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-154580da-d19d-4a70-99a8-7ee84e7e0d16 tempest-GroupSnapshotsTest-1487623336 None] Update group completed successfully. Jun 16 08:57:44 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 1073741824" returned: 0 in 0.764s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:44 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 Jun 16 08:57:44 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:44 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] GroupSnapshot a7ae84e5-85f4-45e9-b64c-8bf8e9d3694d: creating. Jun 16 08:57:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Group snapshot a7ae84e5-85f4-45e9-b64c-8bf8e9d3694d: creating. {{(pid=92348) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 16 08:57:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:44 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308" returned: 0 in 0.625s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:57:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.106s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Creating offline snapshot 1df5fca5-05f4-453b-91e9-adc3e6005184 of volume fe41aab4-ac64-4618-b642-72ff870aa0df {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:57:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8276427e-560b-4504-b8c1-6c4cc8f29ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95149f44-6128-4718-88dc-c7688b02d308', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fe9b40-2baa-471d-b6de-9c045271f227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:44 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf17b43-c945-4849-883f-737d54602319]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:44 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Volume volume-95149f44-6128-4718-88dc-c7688b02d308 (95149f44-6128-4718-88dc-c7688b02d308): created successfully Jun 16 08:57:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fe9b40-2baa-471d-b6de-9c045271f227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Flow 'volume_create_manager' (29627770-4b7b-4ea1-8522-90cdde81e2c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:57:44 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-b42bbb38-0763-4d60-89a0-e390f123ecc7 tempest-SnapshotDependencyTests-108649635 None] Created volume successfully. Jun 16 08:57:44 devstack sudo[108993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df Jun 16 08:57:44 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:45 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df" returned: 0 in 0.712s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:45 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184 1G Jun 16 08:57:45 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:46 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184 1G" returned: 0 in 0.726s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe41aab4-ac64-4618-b642-72ff870aa0df -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:46 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe41aab4-ac64-4618-b642-72ff870aa0df -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184 Jun 16 08:57:46 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:46 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe41aab4-ac64-4618-b642-72ff870aa0df -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184" returned: 0 in 0.631s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:46 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184 is being set with open permissions: ugo+rw: NotImplementedError Jun 16 08:57:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:46 devstack sudo[109008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184 Jun 16 08:57:46 devstack sudo[109008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:47 devstack sudo[109008]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184" returned: 0 in 0.585s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:47 devstack sudo[109011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.info Jun 16 08:57:47 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:48 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.info" returned: 0 in 0.575s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:48 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.info is being set with open permissions: ugo+rw: NotImplementedError Jun 16 08:57:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:48 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.info Jun 16 08:57:48 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:48 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.info" returned: 0 in 0.572s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.879s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Creating offline snapshot 44233421-94c0-4072-bd49-bfca9360f85b of volume 3f1a7fa8-e522-4a5f-9e06-b491f019ee39 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:57:48 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d93772-9a2f-4511-a0a6-d1dec20f1286]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:48 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39 Jun 16 08:57:48 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:49 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39" returned: 0 in 0.688s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:49 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b 1G Jun 16 08:57:49 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:50 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b 1G" returned: 0 in 0.713s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:50 devstack sudo[109030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b Jun 16 08:57:50 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:50 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b" returned: 0 in 0.624s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:50 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b is being set with open permissions: ugo+rw: NotImplementedError Jun 16 08:57:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:50 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b Jun 16 08:57:50 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:51 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b" returned: 0 in 0.566s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:51 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.info Jun 16 08:57:51 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:51 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.info" returned: 0 in 0.606s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:51 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.info is being set with open permissions: ugo+rw: NotImplementedError Jun 16 08:57:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:51 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.info Jun 16 08:57:51 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:52 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.info" returned: 0 in 0.567s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.843s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.809s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:52 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] Creating offline snapshot df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 of volume 95149f44-6128-4718-88dc-c7688b02d308 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:57:52 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc4613b-4d42-4c99-aab2-45c69ff7cd26]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:52 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-81cf6583-7501-4b20-a734-5c0782efc005 tempest-GroupSnapshotsTest-1487623336 None] group_snapshot a7ae84e5-85f4-45e9-b64c-8bf8e9d3694d: created successfully Jun 16 08:57:52 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 Jun 16 08:57:52 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:53 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] group_snapshot a7ae84e5-85f4-45e9-b64c-8bf8e9d3694d: deleting Jun 16 08:57:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] group_snapshot a7ae84e5-85f4-45e9-b64c-8bf8e9d3694d: deleting {{(pid=92348) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 16 08:57:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "cinder-quobyte-fe41aab4-ac64-4618-b642-72ff870aa0df" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:57:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-fe41aab4-ac64-4618-b642-72ff870aa0df" acquired by "delete_snapshot" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:57:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "cinder-quobyte-1df5fca5-05f4-453b-91e9-adc3e6005184" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:57:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-1df5fca5-05f4-453b-91e9-adc3e6005184" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:57:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Deleting offline snapshot 1df5fca5-05f4-453b-91e9-adc3e6005184 of volume fe41aab4-ac64-4618-b642-72ff870aa0df {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:57:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] snapshot_file for this snap is: volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:57:53 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d80777-0986-46ed-b234-de75ccc025f9]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:53 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308" returned: 0 in 0.741s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:53 devstack sudo[109050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 1G Jun 16 08:57:53 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:53 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184 Jun 16 08:57:53 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:53 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184" returned: 0 in 0.731s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe41aab4-ac64-4618-b642-72ff870aa0df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:57:53 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8654eb8f-9c0a-4eba-8c11-a9bde1d36988]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:54 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 1G" returned: 0 in 0.781s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95149f44-6128-4718-88dc-c7688b02d308 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:54 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95149f44-6128-4718-88dc-c7688b02d308 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 Jun 16 08:57:54 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:54 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df Jun 16 08:57:54 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:54 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df" returned: 0 in 0.717s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:54 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95149f44-6128-4718-88dc-c7688b02d308 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5" returned: 0 in 0.659s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:54 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 is being set with open permissions: ugo+rw Jun 16 08:57:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:54 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184 Jun 16 08:57:54 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:54 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 Jun 16 08:57:54 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:55 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5" returned: 0 in 0.611s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:55 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.info Jun 16 08:57:55 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:55 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184" returned: 0 in 0.690s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:55 devstack sudo[109081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184 Jun 16 08:57:55 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:55 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:55 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df.1df5fca5-05f4-453b-91e9-adc3e6005184" returned: 0 in 0.585s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.info" returned: 0 in 0.640s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:55 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.info is being set with open permissions: ugo+rw Jun 16 08:57:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-1df5fca5-05f4-453b-91e9-adc3e6005184" released by "_delete_snapshot" :: held 2.856s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:57:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-fe41aab4-ac64-4618-b642-72ff870aa0df" released by "delete_snapshot" :: held 2.885s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:57:56 devstack sudo[109093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.info Jun 16 08:57:56 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "cinder-quobyte-3f1a7fa8-e522-4a5f-9e06-b491f019ee39" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:57:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-3f1a7fa8-e522-4a5f-9e06-b491f019ee39" acquired by "delete_snapshot" :: waited 0.014s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:57:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "cinder-quobyte-44233421-94c0-4072-bd49-bfca9360f85b" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:57:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-44233421-94c0-4072-bd49-bfca9360f85b" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:57:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Deleting offline snapshot 44233421-94c0-4072-bd49-bfca9360f85b of volume 3f1a7fa8-e522-4a5f-9e06-b491f019ee39 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:57:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] snapshot_file for this snap is: volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:57:56 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc0bed8-0d26-47d7-aed3-de3ec93904a7]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:56 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b Jun 16 08:57:56 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:56 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.info" returned: 0 in 0.600s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.126s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:56 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-abe3e3d1-26b5-4dfb-898c-b39dcc53ae0e tempest-SnapshotDependencyTests-108649635 None] Create snapshot completed successfully Jun 16 08:57:56 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b" returned: 0 in 0.693s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:57:56 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a369fd-a93f-4e5d-9f1f-a94bae81616e]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:56 devstack sudo[109101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39 Jun 16 08:57:56 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:57:57 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Flow 'volume_create_manager' (26dbcccc-30f1-4099-8a57-2e0d00db49af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a4fb2e-2ac0-4b21-ba9c-866a3626df4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39" returned: 0 in 0.773s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a4fb2e-2ac0-4b21-ba9c-866a3626df4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=389ecf60-f73e-42ee-bf85-4847d4e3a0f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce64d028647e45378b536615c46d7003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=df33c3fb-4966-4ebe-9bf6-e790a6fd0af5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:57:57Z,use_quota=True,user_id='8c5244cd9819406385bf081e979d6788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:57 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b Jun 16 08:57:57 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6068f9e6-91cc-4455-8c90-420a04905357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6068f9e6-91cc-4455-8c90-420a04905357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253a913e-faef-4b39-9267-b87425527585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253a913e-faef-4b39-9267-b87425527585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '389ecf60-f73e-42ee-bf85-4847d4e3a0f1', 'volume_name': 'volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1', 'volume_size': 1, 'snapshot_id': 'df33c3fb-4966-4ebe-9bf6-e790a6fd0af5'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3dd943-56e5-4af1-a585-0c4d974fd7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3dd943-56e5-4af1-a585-0c4d974fd7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dce5493-aa31-4bd7-9856-4fa8ee03afdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:57:57 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Volume 389ecf60-f73e-42ee-bf85-4847d4e3a0f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1', 'volume_size': 1, 'snapshot_id': 'df33c3fb-4966-4ebe-9bf6-e790a6fd0af5'} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Acquiring lock "cinder-quobyte-df33c3fb-4966-4ebe-9bf6-e790a6fd0af5-389ecf60-f73e-42ee-bf85-4847d4e3a0f1" by "_create_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-quobyte-df33c3fb-4966-4ebe-9bf6-e790a6fd0af5-389ecf60-f73e-42ee-bf85-4847d4e3a0f1" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Creating volume 389ecf60-f73e-42ee-bf85-4847d4e3a0f1 from snapshot df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 {{(pid=92348) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Acquiring lock "cinder-quobyte-389ecf60-f73e-42ee-bf85-4847d4e3a0f1" by "_copy_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-quobyte-389ecf60-f73e-42ee-bf85-4847d4e3a0f1" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] snapshot: df33c3fb-4966-4ebe-9bf6-e790a6fd0af5, volume: 389ecf60-f73e-42ee-bf85-4847d4e3a0f1, {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2ff24a-bf85-4274-9b01-ba61ec5e77e4]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:57 devstack sudo[109108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 Jun 16 08:57:57 devstack sudo[109108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:58 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b" returned: 0 in 0.678s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:58 devstack sudo[109113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b Jun 16 08:57:58 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:58 devstack sudo[109108]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5" returned: 0 in 0.720s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95149f44-6128-4718-88dc-c7688b02d308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:57:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 16 08:57:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Creating direct copy from snapshot {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 16 08:57:58 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0d07a6-3daa-4aa0-b85c-eecd6abb34fc]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:58 devstack sudo[109118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 Jun 16 08:57:58 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:58 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39.44233421-94c0-4072-bd49-bfca9360f85b" returned: 0 in 0.604s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-44233421-94c0-4072-bd49-bfca9360f85b" released by "_delete_snapshot" :: held 2.847s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:57:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-3f1a7fa8-e522-4a5f-9e06-b491f019ee39" released by "delete_snapshot" :: held 2.872s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:57:59 devstack cinder-volume[92348]: WARNING cinder.quota [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-929933213 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-929933213, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:57:59 devstack cinder-volume[92348]: WARNING cinder.quota [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-929933213 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-929933213, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:57:59 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Created reservations ['b005b340-e1b7-4fbe-aa82-818e12371d34', '8b3c51c6-417c-4f2b-87f4-c99446a3f90a', '5a1a1e45-9ae2-4dd6-8a95-72dd3183cf73', '69ee636d-5ed6-48b9-8120-4c1142c4b903'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:57:59 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] Created reservations ['6d2d5b33-8425-46d8-bab1-34df8426acd6', '901f5b13-1abd-4a8c-b752-318e9ff6affb', '82fcf01b-be90-4da0-a5eb-d1fc0af20f33', '54195f5e-a6e8-4f1c-82db-17bc9c9af793'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:57:59 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root Jun 16 08:57:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308" returned: 0 in 0.732s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:57:59 devstack cinder-volume[92348]: DEBUG cinder.utils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Path /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1 not found in is_blk_device check {{(pid=92348) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 16 08:57:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:59 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-1771790c-474d-4986-babd-b34789d613a3 tempest-GroupSnapshotsTest-1487623336 None] group_snapshot a7ae84e5-85f4-45e9-b64c-8bf8e9d3694d: deleted successfully Jun 16 08:57:59 devstack sudo[109125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1 Jun 16 08:57:59 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:57:59 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "cinder-quobyte-3f1a7fa8-e522-4a5f-9e06-b491f019ee39" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:57:59 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-3f1a7fa8-e522-4a5f-9e06-b491f019ee39" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:57:59 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c779bb-5612-448b-8a01-2d3a68d6bb36]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:57:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:57:59 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39 Jun 16 08:57:59 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:00 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39" returned: 0 in 1.131s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:00 devstack sudo[109142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39 Jun 16 08:58:01 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:01 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3f1a7fa8-e522-4a5f-9e06-b491f019ee39" returned: 0 in 1.001s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-3f1a7fa8-e522-4a5f-9e06-b491f019ee39" released by "delete_volume" :: held 2.215s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "cinder-quobyte-fe41aab4-ac64-4618-b642-72ff870aa0df" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:58:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-fe41aab4-ac64-4618-b642-72ff870aa0df" acquired by "delete_volume" :: waited 0.032s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:58:02 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d21dd05-81d1-445e-8a81-3b55e2aec244]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:58:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:02 devstack sudo[109145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df Jun 16 08:58:02 devstack sudo[109145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df" returned: 0 in 1.912s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:03 devstack sudo[109145]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:04 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df Jun 16 08:58:04 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:04 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1" returned: 0 in 4.966s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:04 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6069b31f-2b7f-4ba9-8698-9540af403dde]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:58:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:04 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 Jun 16 08:58:04 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:04 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fe41aab4-ac64-4618-b642-72ff870aa0df" returned: 0 in 0.611s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:04 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-fe41aab4-ac64-4618-b642-72ff870aa0df" released by "delete_volume" :: held 2.608s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:04 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Created reservations ['7b0fb275-98c2-478f-9f11-50b9b51c59ab'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:58:04 devstack cinder-volume[92348]: WARNING cinder.quota [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-929933213 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-929933213, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:58:04 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Created reservations ['090db95e-3dd1-414f-8ffc-323f2c7e4c53', 'b1ef53ea-6a46-42e8-8d29-6e753d79c06b', 'fe841a55-0f20-4398-9956-f934aa0d0486', '223d0920-d7dc-438f-afdf-7bf9b5ded326'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:58:04 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Created reservations ['97c9a4be-80e6-45ea-b93c-915dab0f7a38', '4104eb79-f178-47d9-8f5f-57578106e008', '40894430-9a31-4ee8-95f3-2ef2e450ee6f', '5f11e295-fde5-46a3-a452-3a6f8c3e1453'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:58:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:04 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:58:04 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:58:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:04 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:58:04 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:05 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308" returned: 0 in 0.844s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:05 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1 {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 08:58:05 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Converted 1024.00 MB image at 206.16 MB/s Jun 16 08:58:05 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1 is being set with open permissions: ugo+rw Jun 16 08:58:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:05 devstack sudo[109161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1 Jun 16 08:58:05 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:05 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.584s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:05 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:58:05 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-50d04274-fa5f-481a-955f-0270d3a5d79e tempest-GroupSnapshotsTest-1487623336 None] Delete group completed successfully. Jun 16 08:58:05 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1" returned: 0 in 0.601s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-quobyte-389ecf60-f73e-42ee-bf85-4847d4e3a0f1" released by "_copy_volume_from_snapshot" :: held 7.945s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-quobyte-df33c3fb-4966-4ebe-9bf6-e790a6fd0af5-389ecf60-f73e-42ee-bf85-4847d4e3a0f1" released by "_create_volume_from_snapshot" :: held 7.975s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.993s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dce5493-aa31-4bd7-9856-4fa8ee03afdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1', 'volume_size': 1, 'snapshot_id': 'df33c3fb-4966-4ebe-9bf6-e790a6fd0af5'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c44625-0c26-427f-956c-32881d64c2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:05 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Volume volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1 (389ecf60-f73e-42ee-bf85-4847d4e3a0f1): created successfully Jun 16 08:58:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c44625-0c26-427f-956c-32881d64c2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:05 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Flow 'volume_create_manager' (26dbcccc-30f1-4099-8a57-2e0d00db49af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:58:05 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-70925a4b-a455-4e67-9c2c-594ee961b536 tempest-SnapshotDependencyTests-108649635 None] Created volume successfully. Jun 16 08:58:06 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c5a9c172-2922-478e-bf37-7d390a4a945e tempest-GroupSnapshotsTest-1487623336 None] Group tempest-GroupSnapshotsTest-Group-42206704: creating Jun 16 08:58:06 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c5a9c172-2922-478e-bf37-7d390a4a945e tempest-GroupSnapshotsTest-1487623336 None] Group tempest-GroupSnapshotsTest-Group-42206704: created successfully Jun 16 08:58:06 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c5a9c172-2922-478e-bf37-7d390a4a945e tempest-GroupSnapshotsTest-1487623336 None] Create group completed successfully. Jun 16 08:58:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] Acquiring lock "cinder-df33c3fb-4966-4ebe-9bf6-e790a6fd0af5-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:58:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-df33c3fb-4966-4ebe-9bf6-e790a6fd0af5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:58:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] Acquiring lock "cinder-quobyte-95149f44-6128-4718-88dc-c7688b02d308" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:58:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-quobyte-95149f44-6128-4718-88dc-c7688b02d308" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:58:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] Acquiring lock "cinder-quobyte-df33c3fb-4966-4ebe-9bf6-e790a6fd0af5" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:58:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-quobyte-df33c3fb-4966-4ebe-9bf6-e790a6fd0af5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:58:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] Deleting offline snapshot df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 of volume 95149f44-6128-4718-88dc-c7688b02d308 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:58:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] snapshot_file for this snap is: volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:58:06 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce49b2e-49db-4e33-9c00-f2ebabfd29f0]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:58:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:06 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 Jun 16 08:58:06 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:07 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5" returned: 0 in 0.683s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95149f44-6128-4718-88dc-c7688b02d308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6a514f-aea5-4c20-b3e3-6cd992eb8dda]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:07 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 Jun 16 08:58:07 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Flow 'volume_create_manager' (ad9a24ef-41e9-48e4-9df7-94f51a63a8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8638e5-c928-4ded-97e4-a0835c9c8495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8638e5-c928-4ded-97e4-a0835c9c8495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1086902838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=917f5c97-caca-47bb-936f-cdd83a01c826,host='devstack@QuobyteHD#QuobyteHD',id=bf8ed225-a60e-4bef-9fe9-5815b21141d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b5b08fc94f422885eaed5f5c7129af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:58:08Z,use_quota=True,user_id='148d601374dc45aaac35c3d0ca531b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5be96e1-2739-44ab-b52d-b013eaebad60),volume_type_id=f5be96e1-2739-44ab-b52d-b013eaebad60)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d616ca98-de93-493e-85ab-fbaa91524b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d616ca98-de93-493e-85ab-fbaa91524b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349f6791-86a7-4378-9a6e-0f5843927b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349f6791-86a7-4378-9a6e-0f5843927b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf8ed225-a60e-4bef-9fe9-5815b21141d9', 'volume_name': 'volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbeb7ce2-208f-4874-9098-bcafa8a7f930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbeb7ce2-208f-4874-9098-bcafa8a7f930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7681ffe1-4d83-48b6-92fe-156b81f3f8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:07 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Volume bf8ed225-a60e-4bef-9fe9-5815b21141d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9', 'volume_size': 1} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=917f5c97-caca-47bb-936f-cdd83a01c826,created_at=2026-06-16T06:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1086902838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=917f5c97-caca-47bb-936f-cdd83a01c826,host='devstack@QuobyteHD#QuobyteHD',id=bf8ed225-a60e-4bef-9fe9-5815b21141d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b5b08fc94f422885eaed5f5c7129af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:58:08Z,use_quota=True,user_id='148d601374dc45aaac35c3d0ca531b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5be96e1-2739-44ab-b52d-b013eaebad60),volume_type_id=f5be96e1-2739-44ab-b52d-b013eaebad60)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Creating volume bf8ed225-a60e-4bef-9fe9-5815b21141d9 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:58:07 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:07 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308" returned: 0 in 0.754s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:07 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9 1073741824 Jun 16 08:58:07 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:07 devstack sudo[109177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 Jun 16 08:58:07 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:08 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5" returned: 0 in 0.675s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:08 devstack sudo[109189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5 Jun 16 08:58:08 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:08 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9 1073741824" returned: 0 in 0.754s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:08 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9 Jun 16 08:58:08 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:09 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308.df33c3fb-4966-4ebe-9bf6-e790a6fd0af5" returned: 0 in 0.615s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-quobyte-df33c3fb-4966-4ebe-9bf6-e790a6fd0af5" released by "_delete_snapshot" :: held 2.819s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-quobyte-95149f44-6128-4718-88dc-c7688b02d308" released by "delete_snapshot" :: held 2.847s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] Created reservations ['68566ee2-d975-43dc-a8d7-6ec22b140977', '176677b7-d370-4ea4-9f22-2dc4bc3e787e', 'f721b201-4ddc-4b1a-96f6-c8c615bd2270', 'cbc7448c-fb4c-40a2-bc4e-4eba21cef5ef'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:58:09 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9" returned: 0 in 0.658s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:09 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] Delete snapshot completed successfully. Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7681ffe1-4d83-48b6-92fe-156b81f3f8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e50b7c-b9ec-4527-9ec5-d20a5c930b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-657fe5fa-c60d-40d4-975b-06d2e48410df tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-df33c3fb-4966-4ebe-9bf6-e790a6fd0af5-delete_snapshot" released by "delete_snapshot" :: held 2.995s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:09 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Volume volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9 (bf8ed225-a60e-4bef-9fe9-5815b21141d9): created successfully Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e50b7c-b9ec-4527-9ec5-d20a5c930b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Flow 'volume_create_manager' (ad9a24ef-41e9-48e4-9df7-94f51a63a8be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:58:09 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-74a3ed04-8d6f-4222-acc0-7e348bc9985e tempest-GroupSnapshotsTest-1487623336 None] Created volume successfully. Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] Acquiring lock "cinder-95149f44-6128-4718-88dc-c7688b02d308-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-95149f44-6128-4718-88dc-c7688b02d308-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] Acquiring lock "cinder-quobyte-95149f44-6128-4718-88dc-c7688b02d308" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-quobyte-95149f44-6128-4718-88dc-c7688b02d308" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a4847b-3dad-4b2d-acdb-fa05357affb4]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:58:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:09 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 Jun 16 08:58:09 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:10 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] GroupSnapshot 63b7d28a-b79a-498a-a8ce-c67ca83ab9c6: creating. Jun 16 08:58:10 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] Group snapshot 63b7d28a-b79a-498a-a8ce-c67ca83ab9c6: creating. {{(pid=92348) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 16 08:58:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:10 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] Creating offline snapshot b1112d8e-e1e4-489f-8062-322cfad5583a of volume bf8ed225-a60e-4bef-9fe9-5815b21141d9 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:58:10 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12211a3-d946-4118-be88-dc5a7f680fc2]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:58:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:10 devstack sudo[109233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9 Jun 16 08:58:10 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:10 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308" returned: 0 in 0.724s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:10 devstack sudo[109238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308 Jun 16 08:58:10 devstack sudo[109238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:10 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9" returned: 0 in 0.699s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:10 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a 1G Jun 16 08:58:10 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:11 devstack sudo[109238]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-95149f44-6128-4718-88dc-c7688b02d308" returned: 0 in 0.596s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-quobyte-95149f44-6128-4718-88dc-c7688b02d308" released by "delete_volume" :: held 1.381s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:UPDATE=105,cinder:SELECT=112,cinder:INSERT=23,cinder:DELETE=5 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] Created reservations ['d4606caf-d6a7-41cc-8930-aa21753260a8', '3ac8fa22-62a6-48ab-8776-dd323f339f1f', '40ec5823-e220-443c-9305-18e27c63063a', 'a219c5c3-bad8-490b-8a56-163c3a6a9646'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:11 devstack sudo[109246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:58:11 devstack sudo[109246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:11 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a 1G" returned: 0 in 0.755s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:11 devstack sudo[109253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a Jun 16 08:58:11 devstack sudo[109253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:11 devstack sudo[109246]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.617s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:58:11 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] Deleted volume successfully. Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c127e496-dee0-4c36-abd7-1d21e122302e tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-95149f44-6128-4718-88dc-c7688b02d308-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] Acquiring lock "cinder-389ecf60-f73e-42ee-bf85-4847d4e3a0f1-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-389ecf60-f73e-42ee-bf85-4847d4e3a0f1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] Acquiring lock "cinder-quobyte-389ecf60-f73e-42ee-bf85-4847d4e3a0f1" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-quobyte-389ecf60-f73e-42ee-bf85-4847d4e3a0f1" acquired by "delete_volume" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e164f935-467a-4408-9f84-6bf9a8e19542]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:58:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:12 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1 Jun 16 08:58:12 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:12 devstack sudo[109253]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a" returned: 0 in 0.650s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:12 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a is being set with open permissions: ugo+rw: NotImplementedError Jun 16 08:58:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:12 devstack sudo[109260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a Jun 16 08:58:12 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:12 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1" returned: 0 in 0.701s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:12 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1 Jun 16 08:58:12 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:12 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a" returned: 0 in 0.586s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:12 devstack sudo[109268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.info Jun 16 08:58:12 devstack sudo[109268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:13 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-389ecf60-f73e-42ee-bf85-4847d4e3a0f1" returned: 0 in 0.592s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-quobyte-389ecf60-f73e-42ee-bf85-4847d4e3a0f1" released by "delete_volume" :: held 1.335s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:13 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] Created reservations ['6fe09284-836b-431b-876a-df91c381c097', '879bf882-f3d2-41b6-96e1-2fcd932c2237', '1126cd8e-c1a9-4632-9274-bfe955ef84e7', '4e04b875-5755-4508-99a1-15ff89190684'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:58:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:58:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:58:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:13 devstack sudo[109271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:58:13 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:13 devstack sudo[109268]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.info" returned: 0 in 0.596s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:13 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.info is being set with open permissions: ugo+rw: NotImplementedError Jun 16 08:58:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:13 devstack sudo[109274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.info Jun 16 08:58:13 devstack sudo[109274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:13 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.587s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:13 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:58:13 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] Deleted volume successfully. Jun 16 08:58:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5be219d3-7ba7-4dce-a63c-df09cf1ff62a tempest-SnapshotDependencyTests-108649635 None] Lock "cinder-389ecf60-f73e-42ee-bf85-4847d4e3a0f1-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:14 devstack sudo[109274]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.info" returned: 0 in 0.623s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.992s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:14 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-f4ba8eb7-c503-4b10-b2c1-a1b01c666270 tempest-GroupSnapshotsTest-1487623336 None] group_snapshot 63b7d28a-b79a-498a-a8ce-c67ca83ab9c6: created successfully Jun 16 08:58:14 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] group_snapshot 63b7d28a-b79a-498a-a8ce-c67ca83ab9c6: deleting Jun 16 08:58:14 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] group_snapshot 63b7d28a-b79a-498a-a8ce-c67ca83ab9c6: deleting {{(pid=92348) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 16 08:58:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "cinder-quobyte-bf8ed225-a60e-4bef-9fe9-5815b21141d9" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:58:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-bf8ed225-a60e-4bef-9fe9-5815b21141d9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:58:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "cinder-quobyte-b1112d8e-e1e4-489f-8062-322cfad5583a" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:58:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-b1112d8e-e1e4-489f-8062-322cfad5583a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:58:14 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] Deleting offline snapshot b1112d8e-e1e4-489f-8062-322cfad5583a of volume bf8ed225-a60e-4bef-9fe9-5815b21141d9 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:58:14 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] snapshot_file for this snap is: volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:58:14 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea84a085-6472-4b3e-b96e-7fa30b6325f4]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:58:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:14 devstack sudo[109278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a Jun 16 08:58:14 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:15 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a" returned: 0 in 0.789s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:15 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:58:15 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5850ff-9ee4-4a71-a863-9d7bb42b1511]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:58:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:15 devstack sudo[109284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9 Jun 16 08:58:15 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:16 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9" returned: 0 in 0.756s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:16 devstack sudo[109290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a Jun 16 08:58:16 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:17 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a" returned: 0 in 0.756s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:17 devstack sudo[109295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a Jun 16 08:58:17 devstack sudo[109295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:17 devstack sudo[109295]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9.b1112d8e-e1e4-489f-8062-322cfad5583a" returned: 0 in 0.656s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-b1112d8e-e1e4-489f-8062-322cfad5583a" released by "_delete_snapshot" :: held 3.084s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-bf8ed225-a60e-4bef-9fe9-5815b21141d9" released by "delete_snapshot" :: held 3.110s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:17 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=109,cinder:INSERT=30,cinder:UPDATE=109,cinder:DELETE=4 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:58:17 devstack cinder-volume[92348]: WARNING cinder.quota [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-746783248 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-746783248, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:58:17 devstack cinder-volume[92348]: WARNING cinder.quota [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-746783248 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-746783248, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:58:17 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] Created reservations ['db36701d-c420-458a-8355-d35629bbc0b5', '65fe4d18-335f-4970-9a1a-f12a0ca7350e', '62d2dc7c-e40a-4f80-90aa-cfe6a61ce945', '455cf060-28cb-40a2-a8c8-fb518826bf86'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:58:17 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-d80ef44f-56fc-44c2-98a8-303733f61181 tempest-GroupSnapshotsTest-1487623336 None] group_snapshot 63b7d28a-b79a-498a-a8ce-c67ca83ab9c6: deleted successfully Jun 16 08:58:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "cinder-quobyte-bf8ed225-a60e-4bef-9fe9-5815b21141d9" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:58:19 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-bf8ed225-a60e-4bef-9fe9-5815b21141d9" acquired by "delete_volume" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:58:19 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f820df5d-37ca-4815-9349-4b9b96176952]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:58:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:19 devstack sudo[109301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9 Jun 16 08:58:19 devstack sudo[109301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:19 devstack sudo[109301]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9" returned: 0 in 0.741s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:19 devstack sudo[109306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9 Jun 16 08:58:19 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:20 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bf8ed225-a60e-4bef-9fe9-5815b21141d9" returned: 0 in 0.719s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] Lock "cinder-quobyte-bf8ed225-a60e-4bef-9fe9-5815b21141d9" released by "delete_volume" :: held 1.540s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:20 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] Created reservations ['fccfdcdf-b864-46f9-a1bd-cb288cca6abb'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:58:20 devstack cinder-volume[92348]: WARNING cinder.quota [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-746783248 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-746783248, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:58:20 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] Created reservations ['59654c5e-d063-42a6-83c4-aee4932b05e5', '2da8cb46-4c92-4a7e-8b8a-ebb935af340d', '4c49a8a7-6ca9-452d-ab9d-fa41e2578de8', 'df3e2397-7017-48c4-a843-87e2184c2239'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:58:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:20 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:58:20 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:58:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:20 devstack sudo[109310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:58:20 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:21 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.635s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:21 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:58:21 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-d8222eb3-9450-4ef5-a90b-23a8f04821d3 tempest-GroupSnapshotsTest-1487623336 None] Delete group completed successfully. Jun 16 08:58:26 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-5406e686-d505-440e-8e47-7e275174abe0 tempest-GroupSnapshotsV319Test-246112255 None] Group tempest-GroupSnapshotsV319Test-Group-2034511411: creating Jun 16 08:58:26 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-5406e686-d505-440e-8e47-7e275174abe0 tempest-GroupSnapshotsV319Test-246112255 None] Group tempest-GroupSnapshotsV319Test-Group-2034511411: created successfully Jun 16 08:58:26 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-5406e686-d505-440e-8e47-7e275174abe0 tempest-GroupSnapshotsV319Test-246112255 None] Create group completed successfully. Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Flow 'volume_create_manager' (eb23bbca-5bf0-4b8f-8761-9cb465d596fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3014638f-7431-42c8-b9ea-5b7c3c01e046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3014638f-7431-42c8-b9ea-5b7c3c01e046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1003237264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d21aeea-fa4b-4286-b8f6-b7562b10e08a,host='devstack@QuobyteHD#QuobyteHD',id=c14ee30c-721e-401b-977d-cc98246f7f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6478212bba0b4c9eada308a59f150978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:58:28Z,use_quota=True,user_id='96987a8266734aa38c96fc31716fb697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ed30864-5345-430d-af21-f9dce49113ed),volume_type_id=2ed30864-5345-430d-af21-f9dce49113ed)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1f5cbc-8109-4281-8561-6d29cee4a179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1f5cbc-8109-4281-8561-6d29cee4a179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d50e42b-a0c4-406b-8cc0-5acae127f5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d50e42b-a0c4-406b-8cc0-5acae127f5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c14ee30c-721e-401b-977d-cc98246f7f18', 'volume_name': 'volume-c14ee30c-721e-401b-977d-cc98246f7f18', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7556d262-d5fe-4e7a-8eee-d94d98ea9ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7556d262-d5fe-4e7a-8eee-d94d98ea9ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92aec78-9d0e-48ce-b33c-dd0f5067726c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:27 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Volume c14ee30c-721e-401b-977d-cc98246f7f18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c14ee30c-721e-401b-977d-cc98246f7f18', 'volume_size': 1} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d21aeea-fa4b-4286-b8f6-b7562b10e08a,created_at=2026-06-16T06:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1003237264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d21aeea-fa4b-4286-b8f6-b7562b10e08a,host='devstack@QuobyteHD#QuobyteHD',id=c14ee30c-721e-401b-977d-cc98246f7f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6478212bba0b4c9eada308a59f150978',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:58:28Z,use_quota=True,user_id='96987a8266734aa38c96fc31716fb697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ed30864-5345-430d-af21-f9dce49113ed),volume_type_id=2ed30864-5345-430d-af21-f9dce49113ed)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Creating volume c14ee30c-721e-401b-977d-cc98246f7f18 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:58:27 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:58:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:27 devstack sudo[109313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18 1073741824 Jun 16 08:58:27 devstack sudo[109313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:28 devstack sudo[109313]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18 1073741824" returned: 0 in 0.740s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:28 devstack sudo[109318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18 Jun 16 08:58:28 devstack sudo[109318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:29 devstack sudo[109318]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18" returned: 0 in 0.586s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:29 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:58:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92aec78-9d0e-48ce-b33c-dd0f5067726c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c14ee30c-721e-401b-977d-cc98246f7f18', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383cf9df-646d-4107-b34c-64227ebcfa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:29 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Volume volume-c14ee30c-721e-401b-977d-cc98246f7f18 (c14ee30c-721e-401b-977d-cc98246f7f18): created successfully Jun 16 08:58:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383cf9df-646d-4107-b34c-64227ebcfa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Flow 'volume_create_manager' (eb23bbca-5bf0-4b8f-8761-9cb465d596fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:58:29 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-2a5a83bf-8416-4730-ae2d-94d5297ca670 tempest-GroupSnapshotsV319Test-246112255 None] Created volume successfully. Jun 16 08:58:29 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] GroupSnapshot eb6554ca-592e-4ae6-8011-90feeb89d6f4: creating. Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] Group snapshot eb6554ca-592e-4ae6-8011-90feeb89d6f4: creating. {{(pid=92348) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] Creating offline snapshot 422178d9-6da7-4ed3-9454-cd5b557dcce1 of volume c14ee30c-721e-401b-977d-cc98246f7f18 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91c8f91-1023-492f-aead-14875079a016]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:30 devstack sudo[109323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18 Jun 16 08:58:30 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:30 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:58:30 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:30 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18" returned: 0 in 0.733s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:30 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.597s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:58:30 devstack sudo[109331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1 1G Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:58:30 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:58:31 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1 1G" returned: 0 in 0.731s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c14ee30c-721e-401b-977d-cc98246f7f18 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:31 devstack sudo[109336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c14ee30c-721e-401b-977d-cc98246f7f18 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1 Jun 16 08:58:31 devstack sudo[109336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:32 devstack sudo[109336]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c14ee30c-721e-401b-977d-cc98246f7f18 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1" returned: 0 in 0.628s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:32 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1 is being set with open permissions: ugo+rw: NotImplementedError Jun 16 08:58:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:32 devstack sudo[109343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1 Jun 16 08:58:32 devstack sudo[109343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:32 devstack sudo[109343]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1" returned: 0 in 0.587s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:32 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.info Jun 16 08:58:32 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:33 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.info" returned: 0 in 0.578s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:33 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.info is being set with open permissions: ugo+rw: NotImplementedError Jun 16 08:58:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:33 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.info Jun 16 08:58:33 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:33 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.info" returned: 0 in 0.578s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.912s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:33 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4086bfa6-528a-40e7-910c-dc391bfd95b3 tempest-GroupSnapshotsV319Test-246112255 None] group_snapshot eb6554ca-592e-4ae6-8011-90feeb89d6f4: created successfully Jun 16 08:58:34 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] group_snapshot eb6554ca-592e-4ae6-8011-90feeb89d6f4: deleting Jun 16 08:58:34 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] group_snapshot eb6554ca-592e-4ae6-8011-90feeb89d6f4: deleting {{(pid=92348) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 16 08:58:34 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] Acquiring lock "cinder-quobyte-c14ee30c-721e-401b-977d-cc98246f7f18" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:58:34 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] Lock "cinder-quobyte-c14ee30c-721e-401b-977d-cc98246f7f18" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:58:34 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] Acquiring lock "cinder-quobyte-422178d9-6da7-4ed3-9454-cd5b557dcce1" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:58:34 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] Lock "cinder-quobyte-422178d9-6da7-4ed3-9454-cd5b557dcce1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:58:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] Deleting offline snapshot 422178d9-6da7-4ed3-9454-cd5b557dcce1 of volume c14ee30c-721e-401b-977d-cc98246f7f18 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:58:34 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] snapshot_file for this snap is: volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:58:34 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f4c670-c1e3-4939-9de6-bf752f2918c1]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:58:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:34 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1 Jun 16 08:58:34 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:35 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1" returned: 0 in 0.677s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c14ee30c-721e-401b-977d-cc98246f7f18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:58:35 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc8fefd-6bfe-4c20-a10e-0c167ed887ce]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:58:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:35 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18 Jun 16 08:58:35 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:36 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18" returned: 0 in 0.696s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:36 devstack sudo[109362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1 Jun 16 08:58:36 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:36 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1" returned: 0 in 0.657s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:36 devstack sudo[109367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1 Jun 16 08:58:36 devstack sudo[109367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:37 devstack sudo[109367]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18.422178d9-6da7-4ed3-9454-cd5b557dcce1" returned: 0 in 0.572s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] Lock "cinder-quobyte-422178d9-6da7-4ed3-9454-cd5b557dcce1" released by "_delete_snapshot" :: held 2.694s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] Lock "cinder-quobyte-c14ee30c-721e-401b-977d-cc98246f7f18" released by "delete_snapshot" :: held 2.715s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:37 devstack cinder-volume[92348]: WARNING cinder.quota [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1842191003 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1842191003, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:58:37 devstack cinder-volume[92348]: WARNING cinder.quota [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1842191003 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1842191003, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:58:37 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] Created reservations ['45750f46-1549-4376-aa22-72f9863cbc9a', '2e4851b6-eea1-47e2-9153-7215ecba32b0', 'ca29914e-4499-4d5c-8fda-f826fe03d148', '348e60cd-1abc-4401-b719-326e7a147a1c'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:58:37 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-6b1d7231-633c-4d41-9390-68a63a2507ab tempest-GroupSnapshotsV319Test-246112255 None] group_snapshot eb6554ca-592e-4ae6-8011-90feeb89d6f4: deleted successfully Jun 16 08:58:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] Acquiring lock "cinder-quobyte-c14ee30c-721e-401b-977d-cc98246f7f18" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:58:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] Lock "cinder-quobyte-c14ee30c-721e-401b-977d-cc98246f7f18" acquired by "delete_volume" :: waited 0.027s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:58:38 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5393ddd-609a-4c1d-9b4c-1fbec173cc46]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:58:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:38 devstack sudo[109370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18 Jun 16 08:58:38 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:38 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18" returned: 0 in 0.696s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:38 devstack sudo[109376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18 Jun 16 08:58:38 devstack sudo[109376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:39 devstack sudo[109376]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c14ee30c-721e-401b-977d-cc98246f7f18" returned: 0 in 0.583s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] Lock "cinder-quobyte-c14ee30c-721e-401b-977d-cc98246f7f18" released by "delete_volume" :: held 1.340s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:39 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] Created reservations ['55124503-c21b-4636-a6c7-b563554edeb1'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:58:39 devstack cinder-volume[92348]: WARNING cinder.quota [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1842191003 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1842191003, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:58:39 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] Created reservations ['ee35d714-c0b0-4501-874c-4d704da03dc4', '10e9141e-ebf2-40f0-829d-ea0c3dc38b01', '5fce7b4c-4bab-4f8c-acfe-934ef7250861', '553caca2-70ee-46b9-8ecb-1ffd79b7d5fc'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:58:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:58:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:58:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:39 devstack sudo[109379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:58:39 devstack sudo[109379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:40 devstack sudo[109379]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.582s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:40 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:58:40 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-fbfe5b7e-ed45-4c02-ac87-d2d9ec80922d tempest-GroupSnapshotsV319Test-246112255 None] Delete group completed successfully. Jun 16 08:58:44 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-9d62f196-7971-4498-abce-c625013059dd tempest-GroupsTest-1804104965 None] Group tempest-Group1-1263288977: creating Jun 16 08:58:44 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-9d62f196-7971-4498-abce-c625013059dd tempest-GroupsTest-1804104965 None] Group tempest-Group1-1263288977: created successfully Jun 16 08:58:44 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-9d62f196-7971-4498-abce-c625013059dd tempest-GroupsTest-1804104965 None] Create group completed successfully. Jun 16 08:58:45 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-0cba3145-6f87-4565-9db7-37286e388b50 tempest-GroupsTest-1804104965 None] Group tempest-Group2-253146164: creating Jun 16 08:58:45 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-0cba3145-6f87-4565-9db7-37286e388b50 tempest-GroupsTest-1804104965 None] Group tempest-Group2-253146164: created successfully Jun 16 08:58:45 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-0cba3145-6f87-4565-9db7-37286e388b50 tempest-GroupsTest-1804104965 None] Create group completed successfully. Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Flow 'volume_create_manager' (075d279a-eb2c-48c2-a936-8edab9494969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3e902c-de63-4b86-994b-85bdcac41e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3e902c-de63-4b86-994b-85bdcac41e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1507261663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3bda4361-1b99-49a0-838d-60cb4e5e3b8e,host='devstack@QuobyteHD#QuobyteHD',id=21802cca-d975-4b03-b03a-f9cb1210b158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e33f5a8ff1d423f816a5ce3db688268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:58:47Z,use_quota=True,user_id='c38fcc8e3b1b4dd6b75b900b2d60a2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978a9d1b-bc6a-48ce-ae0c-483265f44dc5),volume_type_id=978a9d1b-bc6a-48ce-ae0c-483265f44dc5)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80bc109-f153-4ec1-aeae-e6aed74aadff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80bc109-f153-4ec1-aeae-e6aed74aadff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b35a65-ca24-4734-912a-55c07bb1c7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b35a65-ca24-4734-912a-55c07bb1c7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21802cca-d975-4b03-b03a-f9cb1210b158', 'volume_name': 'volume-21802cca-d975-4b03-b03a-f9cb1210b158', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502e8671-219e-4179-9d93-95dc7dd38abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502e8671-219e-4179-9d93-95dc7dd38abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72c4b28-b9d4-4e27-b6c5-148501db261e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:47 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Volume 21802cca-d975-4b03-b03a-f9cb1210b158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21802cca-d975-4b03-b03a-f9cb1210b158', 'volume_size': 1} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3bda4361-1b99-49a0-838d-60cb4e5e3b8e,created_at=2026-06-16T06:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1507261663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3bda4361-1b99-49a0-838d-60cb4e5e3b8e,host='devstack@QuobyteHD#QuobyteHD',id=21802cca-d975-4b03-b03a-f9cb1210b158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e33f5a8ff1d423f816a5ce3db688268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:58:47Z,use_quota=True,user_id='c38fcc8e3b1b4dd6b75b900b2d60a2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978a9d1b-bc6a-48ce-ae0c-483265f44dc5),volume_type_id=978a9d1b-bc6a-48ce-ae0c-483265f44dc5)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Creating volume 21802cca-d975-4b03-b03a-f9cb1210b158 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:58:47 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-21802cca-d975-4b03-b03a-f9cb1210b158 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:47 devstack sudo[109382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-21802cca-d975-4b03-b03a-f9cb1210b158 1073741824 Jun 16 08:58:47 devstack sudo[109382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:47 devstack sudo[109382]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-21802cca-d975-4b03-b03a-f9cb1210b158 1073741824" returned: 0 in 0.738s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-21802cca-d975-4b03-b03a-f9cb1210b158 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:47 devstack sudo[109387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-21802cca-d975-4b03-b03a-f9cb1210b158 Jun 16 08:58:47 devstack sudo[109387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:48 devstack sudo[109387]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-21802cca-d975-4b03-b03a-f9cb1210b158" returned: 0 in 0.589s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:58:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72c4b28-b9d4-4e27-b6c5-148501db261e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21802cca-d975-4b03-b03a-f9cb1210b158', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2ef23b-290c-40d6-938f-675d1dd23ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:48 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Volume volume-21802cca-d975-4b03-b03a-f9cb1210b158 (21802cca-d975-4b03-b03a-f9cb1210b158): created successfully Jun 16 08:58:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2ef23b-290c-40d6-938f-675d1dd23ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Flow 'volume_create_manager' (075d279a-eb2c-48c2-a936-8edab9494969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:58:48 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-85db0b0c-d9e7-4931-af15-dacdd3a22048 tempest-GroupsTest-1804104965 None] Created volume successfully. Jun 16 08:58:49 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] Acquiring lock "cinder-quobyte-21802cca-d975-4b03-b03a-f9cb1210b158" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:58:49 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] Lock "cinder-quobyte-21802cca-d975-4b03-b03a-f9cb1210b158" acquired by "delete_volume" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:58:49 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcaab8b-6292-40ba-9e22-39e260e66f1d]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:58:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-21802cca-d975-4b03-b03a-f9cb1210b158 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:49 devstack sudo[109392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-21802cca-d975-4b03-b03a-f9cb1210b158 Jun 16 08:58:49 devstack sudo[109392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:50 devstack sudo[109392]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-21802cca-d975-4b03-b03a-f9cb1210b158" returned: 0 in 0.689s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-21802cca-d975-4b03-b03a-f9cb1210b158 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:50 devstack sudo[109397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-21802cca-d975-4b03-b03a-f9cb1210b158 Jun 16 08:58:50 devstack sudo[109397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:50 devstack sudo[109397]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-21802cca-d975-4b03-b03a-f9cb1210b158" returned: 0 in 0.572s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] Lock "cinder-quobyte-21802cca-d975-4b03-b03a-f9cb1210b158" released by "delete_volume" :: held 1.315s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:58:51 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] Created reservations ['d29373a7-96cb-4290-9282-dc951c556c3d'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:58:51 devstack cinder-volume[92348]: WARNING cinder.quota [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1962582865 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1962582865, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:58:51 devstack cinder-volume[92348]: WARNING cinder.quota [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1962582865 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1962582865, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:58:51 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] Created reservations ['85b3d918-5b10-47a5-8eaa-35139215bb4e', '2ffd2392-fb5c-4498-9fa7-a42f968b2816', 'a2f830e2-ff48-44b1-bcbb-a8ab393adbf6', '35d20f7e-803c-4dbf-a731-7fc1097b833f'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:58:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:58:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:58:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:51 devstack sudo[109400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:58:51 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:51 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.581s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:51 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:58:51 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-e80ef9a8-c44d-4ecc-a293-e4952f3515d1 tempest-GroupsTest-1804104965 None] Delete group completed successfully. Jun 16 08:58:51 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-a6ea7225-8c1a-49cc-9777-314e6891ce8c tempest-GroupsTest-1804104965 None] Created reservations ['0c45c579-b69c-4f76-93ed-40507f48a8d0'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:58:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a6ea7225-8c1a-49cc-9777-314e6891ce8c tempest-GroupsTest-1804104965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a6ea7225-8c1a-49cc-9777-314e6891ce8c tempest-GroupsTest-1804104965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:51 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea7225-8c1a-49cc-9777-314e6891ce8c tempest-GroupsTest-1804104965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:58:52 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea7225-8c1a-49cc-9777-314e6891ce8c tempest-GroupsTest-1804104965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:58:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a6ea7225-8c1a-49cc-9777-314e6891ce8c tempest-GroupsTest-1804104965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a6ea7225-8c1a-49cc-9777-314e6891ce8c tempest-GroupsTest-1804104965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:52 devstack sudo[109403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:58:52 devstack sudo[109403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:52 devstack sudo[109403]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a6ea7225-8c1a-49cc-9777-314e6891ce8c tempest-GroupsTest-1804104965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.582s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:52 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-a6ea7225-8c1a-49cc-9777-314e6891ce8c tempest-GroupsTest-1804104965 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:58:52 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-a6ea7225-8c1a-49cc-9777-314e6891ce8c tempest-GroupsTest-1804104965 None] Delete group completed successfully. Jun 16 08:58:53 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-81349010-eebf-4e6f-97b6-1cc6f877469e tempest-GroupsTest-1804104965 None] Group tempest-GroupsTest-Group-1943280956: creating Jun 16 08:58:53 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-81349010-eebf-4e6f-97b6-1cc6f877469e tempest-GroupsTest-1804104965 None] Group tempest-GroupsTest-Group-1943280956: created successfully Jun 16 08:58:53 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-81349010-eebf-4e6f-97b6-1cc6f877469e tempest-GroupsTest-1804104965 None] Create group completed successfully. Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Flow 'volume_create_manager' (6d479da0-86ef-4c78-b873-74810ecd4a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95528b18-c526-4892-83e7-4585ca1788d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95528b18-c526-4892-83e7-4585ca1788d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-639554117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=265231df-a47e-4572-ac35-a4ef71800404,host='devstack@QuobyteHD#QuobyteHD',id=bd7daf85-2cae-4a38-9f30-4c1fbc53b36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e33f5a8ff1d423f816a5ce3db688268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:58:55Z,use_quota=True,user_id='c38fcc8e3b1b4dd6b75b900b2d60a2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fdc9e6e-0cfe-4291-8036-9f53bfa9d7d5),volume_type_id=7fdc9e6e-0cfe-4291-8036-9f53bfa9d7d5)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89322d92-10c8-4cb5-9f9e-6fee78d96659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89322d92-10c8-4cb5-9f9e-6fee78d96659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934d99f3-8a98-4ea8-a869-07febfa85d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934d99f3-8a98-4ea8-a869-07febfa85d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd7daf85-2cae-4a38-9f30-4c1fbc53b36b', 'volume_name': 'volume-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a0e7ba-468a-452d-96eb-85f324d174bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a0e7ba-468a-452d-96eb-85f324d174bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed18eed-8972-46f3-b983-e28d81077d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:54 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Volume bd7daf85-2cae-4a38-9f30-4c1fbc53b36b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b', 'volume_size': 1} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=265231df-a47e-4572-ac35-a4ef71800404,created_at=2026-06-16T06:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-639554117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=265231df-a47e-4572-ac35-a4ef71800404,host='devstack@QuobyteHD#QuobyteHD',id=bd7daf85-2cae-4a38-9f30-4c1fbc53b36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e33f5a8ff1d423f816a5ce3db688268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:58:55Z,use_quota=True,user_id='c38fcc8e3b1b4dd6b75b900b2d60a2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fdc9e6e-0cfe-4291-8036-9f53bfa9d7d5),volume_type_id=7fdc9e6e-0cfe-4291-8036-9f53bfa9d7d5)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Creating volume bd7daf85-2cae-4a38-9f30-4c1fbc53b36b {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:58:54 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:58:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:54 devstack sudo[109406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b 1073741824 Jun 16 08:58:54 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:55 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b 1073741824" returned: 0 in 0.728s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:55 devstack sudo[109411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b Jun 16 08:58:55 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:56 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b" returned: 0 in 0.568s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:58:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:56 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed18eed-8972-46f3-b983-e28d81077d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:56 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69a0ef5-ced3-4a72-9a7b-95cb059c717b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:56 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Volume volume-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b (bd7daf85-2cae-4a38-9f30-4c1fbc53b36b): created successfully Jun 16 08:58:56 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69a0ef5-ced3-4a72-9a7b-95cb059c717b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:56 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Flow 'volume_create_manager' (6d479da0-86ef-4c78-b873-74810ecd4a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:58:56 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-babfe198-c2aa-415d-83cb-2c46df4ad803 tempest-GroupsTest-1804104965 None] Created volume successfully. Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Flow 'volume_create_manager' (28ab4f0a-96ff-4784-a71c-95a5802cbad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415592cb-ae0a-441f-924d-88250ff6c572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415592cb-ae0a-441f-924d-88250ff6c572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1827693058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=265231df-a47e-4572-ac35-a4ef71800404,host='devstack@QuobyteHD#QuobyteHD',id=eaf9740c-6afb-471d-8542-ba8d1c7ffc72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e33f5a8ff1d423f816a5ce3db688268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:58:57Z,use_quota=True,user_id='c38fcc8e3b1b4dd6b75b900b2d60a2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fdc9e6e-0cfe-4291-8036-9f53bfa9d7d5),volume_type_id=7fdc9e6e-0cfe-4291-8036-9f53bfa9d7d5)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc3a16a-f9fd-42bf-a1ba-d72dfe95a5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc3a16a-f9fd-42bf-a1ba-d72dfe95a5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8b6279-6191-4393-82bc-845e58498421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8b6279-6191-4393-82bc-845e58498421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaf9740c-6afb-471d-8542-ba8d1c7ffc72', 'volume_name': 'volume-eaf9740c-6afb-471d-8542-ba8d1c7ffc72', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416f0d91-4ae7-445c-8dd1-76690036d51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416f0d91-4ae7-445c-8dd1-76690036d51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2316191-0630-4a4b-ab9b-df94a28ab6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:57 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Volume eaf9740c-6afb-471d-8542-ba8d1c7ffc72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaf9740c-6afb-471d-8542-ba8d1c7ffc72', 'volume_size': 1} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=265231df-a47e-4572-ac35-a4ef71800404,created_at=2026-06-16T06:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1827693058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=265231df-a47e-4572-ac35-a4ef71800404,host='devstack@QuobyteHD#QuobyteHD',id=eaf9740c-6afb-471d-8542-ba8d1c7ffc72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e33f5a8ff1d423f816a5ce3db688268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:58:57Z,use_quota=True,user_id='c38fcc8e3b1b4dd6b75b900b2d60a2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fdc9e6e-0cfe-4291-8036-9f53bfa9d7d5),volume_type_id=7fdc9e6e-0cfe-4291-8036-9f53bfa9d7d5)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Creating volume eaf9740c-6afb-471d-8542-ba8d1c7ffc72 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:58:57 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:58:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-eaf9740c-6afb-471d-8542-ba8d1c7ffc72 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:57 devstack sudo[109420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-eaf9740c-6afb-471d-8542-ba8d1c7ffc72 1073741824 Jun 16 08:58:57 devstack sudo[109420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:58 devstack sudo[109420]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-eaf9740c-6afb-471d-8542-ba8d1c7ffc72 1073741824" returned: 0 in 0.725s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-eaf9740c-6afb-471d-8542-ba8d1c7ffc72 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:58:58 devstack sudo[109425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-eaf9740c-6afb-471d-8542-ba8d1c7ffc72 Jun 16 08:58:58 devstack sudo[109425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:58:58 devstack sudo[109425]: pam_unix(sudo:session): session closed for user root Jun 16 08:58:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-eaf9740c-6afb-471d-8542-ba8d1c7ffc72" returned: 0 in 0.578s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:58:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:58:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:58:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2316191-0630-4a4b-ab9b-df94a28ab6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaf9740c-6afb-471d-8542-ba8d1c7ffc72', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c900ce-291d-4795-9cfc-2511ab4ce626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:58:58 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Volume volume-eaf9740c-6afb-471d-8542-ba8d1c7ffc72 (eaf9740c-6afb-471d-8542-ba8d1c7ffc72): created successfully Jun 16 08:58:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c900ce-291d-4795-9cfc-2511ab4ce626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:58:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Flow 'volume_create_manager' (28ab4f0a-96ff-4784-a71c-95a5802cbad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:58:58 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-2b1e477a-bcfa-4af7-be54-3f1806020551 tempest-GroupsTest-1804104965 None] Created volume successfully. Jun 16 08:58:59 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-1f7cfab6-c2cd-4efb-9bce-f10ee76d667a tempest-GroupsTest-1804104965 None] Update group completed successfully. Jun 16 08:59:01 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-e0081170-4f8a-41a3-a2cd-f9df6739c108 tempest-GroupsTest-1804104965 None] Update group completed successfully. Jun 16 08:59:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Acquiring lock "cinder-quobyte-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:59:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Lock "cinder-quobyte-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b" acquired by "delete_volume" :: waited 0.020s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:59:02 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a293e7-2a72-4328-b48d-32c81a07e036]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:59:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:02 devstack sudo[109429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b Jun 16 08:59:02 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:03 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b" returned: 0 in 0.698s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:03 devstack sudo[109434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b Jun 16 08:59:03 devstack sudo[109434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:03 devstack sudo[109434]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b" returned: 0 in 0.595s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Lock "cinder-quobyte-bd7daf85-2cae-4a38-9f30-4c1fbc53b36b" released by "delete_volume" :: held 1.341s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:59:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Acquiring lock "cinder-quobyte-eaf9740c-6afb-471d-8542-ba8d1c7ffc72" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:59:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Lock "cinder-quobyte-eaf9740c-6afb-471d-8542-ba8d1c7ffc72" acquired by "delete_volume" :: waited 0.013s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:59:03 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebe213a-9ff4-413b-89b0-06698c7bdd94]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:59:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-eaf9740c-6afb-471d-8542-ba8d1c7ffc72 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:03 devstack sudo[109437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-eaf9740c-6afb-471d-8542-ba8d1c7ffc72 Jun 16 08:59:03 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:04 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-eaf9740c-6afb-471d-8542-ba8d1c7ffc72" returned: 0 in 0.688s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-eaf9740c-6afb-471d-8542-ba8d1c7ffc72 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:04 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-eaf9740c-6afb-471d-8542-ba8d1c7ffc72 Jun 16 08:59:04 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:05 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-eaf9740c-6afb-471d-8542-ba8d1c7ffc72" returned: 0 in 0.586s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Lock "cinder-quobyte-eaf9740c-6afb-471d-8542-ba8d1c7ffc72" released by "delete_volume" :: held 1.309s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:59:05 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Created reservations ['919d1fdd-53ad-480e-95d8-85b9220464b6'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:59:05 devstack cinder-volume[92348]: WARNING cinder.quota [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1995336796 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1995336796, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:59:05 devstack cinder-volume[92348]: WARNING cinder.quota [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1995336796 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1995336796, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:59:05 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Created reservations ['9ade802e-64bd-4c01-a7b0-977aed51bca4', '94e32d1a-0786-488e-a967-6d0b3c4e4516', '11ddae3d-f13f-4628-b8de-eeca6549a566', '1710b068-bd94-447c-9e21-99ca51771e17'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:59:05 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Created reservations ['ab6281ed-a523-4880-ad96-64658c7fcb53', '259f531b-4abc-495a-b7e3-f5c66a80b5b1', '0d0783e9-fdce-4db3-a4d2-7242cdcf43a9', '7ed15f7b-5432-4fba-8fdb-db13213e0126'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:59:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:59:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:59:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:59:05 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:59:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:59:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:05 devstack sudo[109445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:59:05 devstack sudo[109445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:05 devstack sudo[109445]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.607s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:05 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:59:05 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-59f7ce92-00be-4bf7-82ff-0f8a5af270c6 tempest-GroupsTest-1804104965 None] Delete group completed successfully. Jun 16 08:59:15 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:INSERT=23,cinder:UPDATE=105,cinder:DELETE=4,cinder:SELECT=99 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:59:15 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=71,cinder:INSERT=19,cinder:UPDATE=87,cinder:DELETE=1 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Flow 'volume_create_manager' (ab4a2c4c-e187-48d8-aa3f-a754f33f1888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aad801a-dd0e-4458-a5a0-51e8bbbaab73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aad801a-dd0e-4458-a5a0-51e8bbbaab73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1225289709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da7ad0d-d7db-4e1e-9c15-5e55e9e42494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d0127f31334124b675f1191d20831e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:59:23Z,use_quota=True,user_id='4e42029c028c49fab520878e0c566397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f36959-6262-447d-a0e6-2dbae3635f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f36959-6262-447d-a0e6-2dbae3635f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c0fb20-d901-4dd4-8c25-6130d800f95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c0fb20-d901-4dd4-8c25-6130d800f95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da7ad0d-d7db-4e1e-9c15-5e55e9e42494', 'volume_name': 'volume-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35bd4c06-aa97-49c8-838f-20a9decaecb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35bd4c06-aa97-49c8-838f-20a9decaecb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e84bde-531e-4926-840c-93c33e7cfd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:23 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Volume 7da7ad0d-d7db-4e1e-9c15-5e55e9e42494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494', 'volume_size': 1} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1225289709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da7ad0d-d7db-4e1e-9c15-5e55e9e42494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d0127f31334124b675f1191d20831e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:59:23Z,use_quota=True,user_id='4e42029c028c49fab520878e0c566397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Creating volume 7da7ad0d-d7db-4e1e-9c15-5e55e9e42494 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:59:23 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:59:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:23 devstack sudo[109489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494 1073741824 Jun 16 08:59:23 devstack sudo[109489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:24 devstack sudo[109489]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494 1073741824" returned: 0 in 0.776s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:24 devstack sudo[109494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494 Jun 16 08:59:24 devstack sudo[109494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:24 devstack sudo[109494]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494" returned: 0 in 0.580s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:24 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:59:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:59:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e84bde-531e-4926-840c-93c33e7cfd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f51d4c1-9013-49ba-a741-56492d18a01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:24 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Volume volume-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494 (7da7ad0d-d7db-4e1e-9c15-5e55e9e42494): created successfully Jun 16 08:59:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f51d4c1-9013-49ba-a741-56492d18a01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Flow 'volume_create_manager' (ab4a2c4c-e187-48d8-aa3f-a754f33f1888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:59:24 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-8788fd72-5b2c-4a27-9c45-74a2acf9b32a tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Created volume successfully. Jun 16 08:59:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Acquiring lock "cinder-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:59:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Lock "cinder-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:59:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Acquiring lock "cinder-quobyte-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:59:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Lock "cinder-quobyte-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494" acquired by "delete_volume" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:59:26 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf38fe6-1f0c-4f92-bb1d-aaf1d7ff006b]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:59:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:26 devstack sudo[109497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494 Jun 16 08:59:26 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:27 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494" returned: 0 in 0.696s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:27 devstack sudo[109502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494 Jun 16 08:59:27 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:27 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494" returned: 0 in 0.568s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:27 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Lock "cinder-quobyte-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494" released by "delete_volume" :: held 1.301s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:59:27 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Created reservations ['2cba82e9-b66b-472a-8a68-00835a65686c', '6f2fe583-07ec-40f5-8ffa-8d17ecd05688', '2a9bc9ad-d961-40d3-a6e6-767fb4cb39f9', '6e3a11a3-379f-48ff-bbf0-be1a00aa9b4b'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:59:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:59:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:59:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:59:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:59:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:59:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:27 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:59:27 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:28 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.566s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:28 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:59:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Deleted volume successfully. Jun 16 08:59:28 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-25386c75-35f4-4295-a4b4-8ece9895a6f7 tempest-VolumeQuotasNegativeTestJSON-1684649412 None] Lock "cinder-7da7ad0d-d7db-4e1e-9c15-5e55e9e42494-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:59:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:59:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:59:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:59:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:59:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:59:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:59:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:30 devstack sudo[109510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:59:30 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:30 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.608s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:30 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:59:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 08:59:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 08:59:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Flow 'volume_create_manager' (84472191-c47c-429a-bc10-e4e19cd59382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5230104c-f39d-415d-b647-cf44a864208a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5230104c-f39d-415d-b647-cf44a864208a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1131461874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b3cb5f-6771-4192-bc85-1252e4c1b9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d3edaf79454e858cc30c8d68a43356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:59:37Z,use_quota=True,user_id='5dd3d7a830a047858f71fc35d221ffbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202dd0eb-f2a5-454c-bf8a-b950829ac1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202dd0eb-f2a5-454c-bf8a-b950829ac1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94bda732-9c2b-44f8-b826-ae8f4cfdb4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94bda732-9c2b-44f8-b826-ae8f4cfdb4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6b3cb5f-6771-4192-bc85-1252e4c1b9c3', 'volume_name': 'volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20ab672-b87c-4bc0-9f44-d4c589a1bde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20ab672-b87c-4bc0-9f44-d4c589a1bde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07622f6-241e-4cbf-affb-59b6ae5d9c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:37 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Volume f6b3cb5f-6771-4192-bc85-1252e4c1b9c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3', 'volume_size': 1} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1131461874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b3cb5f-6771-4192-bc85-1252e4c1b9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d3edaf79454e858cc30c8d68a43356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:59:37Z,use_quota=True,user_id='5dd3d7a830a047858f71fc35d221ffbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Creating volume f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:59:37 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:37 devstack sudo[109515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 1073741824 Jun 16 08:59:37 devstack sudo[109515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:37 devstack sudo[109515]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 1073741824" returned: 0 in 0.728s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:37 devstack sudo[109521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 Jun 16 08:59:37 devstack sudo[109521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:38 devstack sudo[109521]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3" returned: 0 in 0.575s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:59:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:59:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07622f6-241e-4cbf-affb-59b6ae5d9c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0f0ca9-a7cb-435c-8335-6aebd855631f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:38 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Volume volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 (f6b3cb5f-6771-4192-bc85-1252e4c1b9c3): created successfully Jun 16 08:59:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0f0ca9-a7cb-435c-8335-6aebd855631f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Flow 'volume_create_manager' (84472191-c47c-429a-bc10-e4e19cd59382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:59:38 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-053300f5-8d44-447d-918e-59801dabe7ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Created volume successfully. Jun 16 08:59:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:59:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:59:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Creating offline snapshot 183f43a4-f0f3-4099-8d1b-a1acb75bd203 of volume f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 08:59:39 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e5dca9-874a-4de9-8ac5-676d3c5f076f]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:59:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:39 devstack sudo[109525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 Jun 16 08:59:39 devstack sudo[109525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:40 devstack sudo[109525]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3" returned: 0 in 0.676s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:40 devstack sudo[109530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203 1G Jun 16 08:59:40 devstack sudo[109530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:40 devstack sudo[109530]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203 1G" returned: 0 in 0.733s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:40 devstack sudo[109535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203 Jun 16 08:59:40 devstack sudo[109535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:41 devstack sudo[109535]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203" returned: 0 in 0.608s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:41 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203 is being set with open permissions: ugo+rw Jun 16 08:59:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:41 devstack sudo[109540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203 Jun 16 08:59:41 devstack sudo[109540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:42 devstack sudo[109540]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203" returned: 0 in 0.569s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:42 devstack sudo[109543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.info Jun 16 08:59:42 devstack sudo[109543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:42 devstack sudo[109543]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.info" returned: 0 in 0.566s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:42 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.info is being set with open permissions: ugo+rw Jun 16 08:59:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:42 devstack sudo[109546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.info Jun 16 08:59:42 devstack sudo[109546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:43 devstack sudo[109546]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.info" returned: 0 in 0.568s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.800s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:59:43 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-bcfa3b3b-bca6-4925-8281-3cc929273d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Create snapshot completed successfully Jun 16 08:59:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Acquiring lock "cinder-183f43a4-f0f3-4099-8d1b-a1acb75bd203-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:59:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "cinder-183f43a4-f0f3-4099-8d1b-a1acb75bd203-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:59:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Acquiring lock "cinder-quobyte-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:59:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "cinder-quobyte-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:59:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Acquiring lock "cinder-quobyte-183f43a4-f0f3-4099-8d1b-a1acb75bd203" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:59:44 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "cinder-quobyte-183f43a4-f0f3-4099-8d1b-a1acb75bd203" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:59:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Deleting offline snapshot 183f43a4-f0f3-4099-8d1b-a1acb75bd203 of volume f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 08:59:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] snapshot_file for this snap is: volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 08:59:44 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[370cd8e9-7184-49cc-a773-9d3e9e218bb4]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:59:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:44 devstack sudo[109549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203 Jun 16 08:59:44 devstack sudo[109549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:44 devstack sudo[109549]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203" returned: 0 in 0.677s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 08:59:44 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa23f09-da73-46ea-91cc-9dab0c0fcbd7]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:59:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:44 devstack sudo[109554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 Jun 16 08:59:44 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:45 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3" returned: 0 in 0.683s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:45 devstack sudo[109559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203 Jun 16 08:59:45 devstack sudo[109559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:46 devstack sudo[109559]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203" returned: 0 in 0.666s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:46 devstack sudo[109564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203 Jun 16 08:59:46 devstack sudo[109564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:46 devstack sudo[109564]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3.183f43a4-f0f3-4099-8d1b-a1acb75bd203" returned: 0 in 0.569s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "cinder-quobyte-183f43a4-f0f3-4099-8d1b-a1acb75bd203" released by "_delete_snapshot" :: held 2.686s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:59:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "cinder-quobyte-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3" released by "delete_snapshot" :: held 2.710s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:59:46 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Created reservations ['20db0bd3-3136-46a6-9087-a027a4a5e463', 'd6555a44-569c-4118-910f-8298f57a819f', 'd7a37796-a9da-4c8d-b5fb-3bb8de31feb4', '717a9b95-f857-486f-8c7a-e5dd0cdfe22c'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:59:46 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Delete snapshot completed successfully. Jun 16 08:59:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a9bf5810-6c99-495f-98ed-6562b904927b tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "cinder-183f43a4-f0f3-4099-8d1b-a1acb75bd203-delete_snapshot" released by "delete_snapshot" :: held 2.828s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:59:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Acquiring lock "cinder-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:59:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "cinder-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:59:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Acquiring lock "cinder-quobyte-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:59:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "cinder-quobyte-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:59:47 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdb8831-34ea-455e-a183-9edd881cca88]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:59:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:47 devstack sudo[109567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 Jun 16 08:59:47 devstack sudo[109567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:47 devstack sudo[109567]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3" returned: 0 in 0.677s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:47 devstack sudo[109572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3 Jun 16 08:59:47 devstack sudo[109572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:48 devstack sudo[109572]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3" returned: 0 in 0.572s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "cinder-quobyte-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3" released by "delete_volume" :: held 1.301s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:59:48 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Created reservations ['62397f95-7aaa-4fa9-9ebe-72f43bfba40c', 'bf7da2cf-cc60-48de-b777-804af9103144', 'ff721c76-362a-4aa6-9dc3-def5838ab852', 'd7177949-f98d-4ac6-90db-1d204cd764be'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:59:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:59:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:59:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:59:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:59:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:59:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:48 devstack sudo[109576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:59:48 devstack sudo[109576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:49 devstack sudo[109576]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.591s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:49 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:59:49 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Deleted volume successfully. Jun 16 08:59:49 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-7a4700a6-a014-48a2-b4ba-8fccb74dd676 tempest-VolumeSnapshotQuotasNegativeTestJSON-1786746902 None] Lock "cinder-f6b3cb5f-6771-4192-bc85-1252e4c1b9c3-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Flow 'volume_create_manager' (a2a00b22-134d-4c0a-9588-584585957d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f05938c-3b70-4954-82ae-e41e65909838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f05938c-3b70-4954-82ae-e41e65909838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-851599714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a2bf3c8aa2f4972ac9d5a0d2f3d09bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:59:54Z,use_quota=True,user_id='a5759823969b49f282b3fecbe370d899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c18e4c94-37c4-445e-a96b-6d51331eb2a4),volume_type_id=c18e4c94-37c4-445e-a96b-6d51331eb2a4)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077a35ad-e8c0-4fab-a4b4-9e76f15b4034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077a35ad-e8c0-4fab-a4b4-9e76f15b4034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efdf54ee-697a-40aa-b884-5428066a51b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efdf54ee-697a-40aa-b884-5428066a51b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4', 'volume_name': 'volume-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c7fbca-2e86-4dae-8425-b1a6cc82f28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c7fbca-2e86-4dae-8425-b1a6cc82f28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a086eddd-8c62-49ee-9988-5f83358f82e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:54 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Volume 9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4', 'volume_size': 1} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T06:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-851599714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a2bf3c8aa2f4972ac9d5a0d2f3d09bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T06:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T06:59:54Z,use_quota=True,user_id='a5759823969b49f282b3fecbe370d899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c18e4c94-37c4-445e-a96b-6d51331eb2a4),volume_type_id=c18e4c94-37c4-445e-a96b-6d51331eb2a4)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Creating volume 9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 08:59:54 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 08:59:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:54 devstack sudo[109579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4 1073741824 Jun 16 08:59:54 devstack sudo[109579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:55 devstack sudo[109579]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4 1073741824" returned: 0 in 0.725s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:55 devstack sudo[109584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4 Jun 16 08:59:55 devstack sudo[109584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:55 devstack sudo[109584]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4" returned: 0 in 0.603s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 08:59:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:59:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a086eddd-8c62-49ee-9988-5f83358f82e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d11587-630c-491f-8bca-31ec8fb2a6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 08:59:55 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Volume volume-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4 (9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4): created successfully Jun 16 08:59:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d11587-630c-491f-8bca-31ec8fb2a6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 08:59:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Flow 'volume_create_manager' (a2a00b22-134d-4c0a-9588-584585957d92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 08:59:55 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-82a3aa08-79d3-44a5-8b65-0d2b199eb19b tempest-VolumeTypesAccessTest-85429775 None] Created volume successfully. Jun 16 08:59:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Acquiring lock "cinder-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:59:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Lock "cinder-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:59:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Acquiring lock "cinder-quobyte-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 08:59:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Lock "cinder-quobyte-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4" acquired by "delete_volume" :: waited 0.014s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 08:59:56 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c96adc-d18a-41cd-b45e-b4f68362b6fb]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 08:59:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:56 devstack sudo[109593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4 Jun 16 08:59:56 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:57 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4" returned: 0 in 0.684s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:57 devstack sudo[109598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4 Jun 16 08:59:57 devstack sudo[109598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:57 devstack sudo[109598]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4" returned: 0 in 0.570s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Lock "cinder-quobyte-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4" released by "delete_volume" :: held 1.289s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 08:59:58 devstack cinder-volume[92348]: WARNING cinder.quota [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-34071524 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-34071524, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:59:58 devstack cinder-volume[92348]: WARNING cinder.quota [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-34071524 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-34071524, it is now deprecated. Please use the default quota class for default quota. Jun 16 08:59:58 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Created reservations ['1cc2ac05-7a04-461b-97f8-c8082587f002', '5ff8372e-309f-4a05-81e9-67bbb7c5c480', 'cfbb6dff-5dd7-4cb6-82fd-95b67790304b', '76f1254d-5e6c-4a4d-948f-d136d2d951df'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 08:59:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 08:59:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 08:59:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 08:59:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 08:59:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 08:59:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 08:59:58 devstack sudo[109601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 08:59:58 devstack sudo[109601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 08:59:58 devstack sudo[109601]: pam_unix(sudo:session): session closed for user root Jun 16 08:59:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.574s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 08:59:58 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 08:59:58 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Deleted volume successfully. Jun 16 08:59:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-af271168-6f21-4836-a4e9-8e3074b0f865 tempest-VolumeTypesAccessTest-85429775 None] Lock "cinder-9be9c3d7-ed3e-4ebe-8696-6ccc81fd32c4-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:00:08 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=35,cinder:UPDATE=41,cinder:INSERT=11,cinder:DELETE=3 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 09:00:08 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=25,cinder:UPDATE=39,cinder:INSERT=9,cinder:DELETE=4 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Flow 'volume_create_manager' (e1ff77cb-7b45-4b2a-9581-53a9d7c29603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5388ee-ab4c-4526-814f-c2c4bd0d7ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5388ee-ab4c-4526-814f-c2c4bd0d7ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1535791213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd125aa-aa20-4522-9483-ed8c367de8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fe5a576651472497a6048dadd7b307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:00:12Z,use_quota=True,user_id='996ccf90f1734addb8bf701a3fe50bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311f9464-d906-4628-9d83-79ce66505713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311f9464-d906-4628-9d83-79ce66505713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95894e7e-9ae6-445b-bc63-0066b1792e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95894e7e-9ae6-445b-bc63-0066b1792e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dd125aa-aa20-4522-9483-ed8c367de8d8', 'volume_name': 'volume-4dd125aa-aa20-4522-9483-ed8c367de8d8', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad4ae6b-51bd-4d54-b7e8-95959be2e803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad4ae6b-51bd-4d54-b7e8-95959be2e803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5266722-6704-49f5-a03c-b00dce361ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:11 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Volume 4dd125aa-aa20-4522-9483-ed8c367de8d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dd125aa-aa20-4522-9483-ed8c367de8d8', 'volume_size': 1} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1535791213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd125aa-aa20-4522-9483-ed8c367de8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fe5a576651472497a6048dadd7b307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:00:12Z,use_quota=True,user_id='996ccf90f1734addb8bf701a3fe50bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Creating volume 4dd125aa-aa20-4522-9483-ed8c367de8d8 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:00:11 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:00:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd125aa-aa20-4522-9483-ed8c367de8d8 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:00:11 devstack sudo[109646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd125aa-aa20-4522-9483-ed8c367de8d8 1073741824 Jun 16 09:00:11 devstack sudo[109646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:00:12 devstack sudo[109646]: pam_unix(sudo:session): session closed for user root Jun 16 09:00:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd125aa-aa20-4522-9483-ed8c367de8d8 1073741824" returned: 0 in 0.755s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:00:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd125aa-aa20-4522-9483-ed8c367de8d8 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:00:12 devstack sudo[109651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd125aa-aa20-4522-9483-ed8c367de8d8 Jun 16 09:00:12 devstack sudo[109651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:00:13 devstack sudo[109651]: pam_unix(sudo:session): session closed for user root Jun 16 09:00:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd125aa-aa20-4522-9483-ed8c367de8d8" returned: 0 in 0.591s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:00:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:00:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:00:13 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5266722-6704-49f5-a03c-b00dce361ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dd125aa-aa20-4522-9483-ed8c367de8d8', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:13 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f097a48b-d1e8-41ba-aadd-f870a0ef4a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:13 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Volume volume-4dd125aa-aa20-4522-9483-ed8c367de8d8 (4dd125aa-aa20-4522-9483-ed8c367de8d8): created successfully Jun 16 09:00:13 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f097a48b-d1e8-41ba-aadd-f870a0ef4a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:13 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Flow 'volume_create_manager' (e1ff77cb-7b45-4b2a-9581-53a9d7c29603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:00:13 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-919aa4ee-f903-44b2-a2f7-d49decdd190a tempest-VolumesTransfersTest-1187061713 None] Created volume successfully. Jun 16 09:00:14 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-b57f60fd-5ca2-42bf-a7bf-d8bd5cf1b455 tempest-VolumesTransfersTest-13655464 None] Transfer volume completed successfully. Jun 16 09:00:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] Acquiring lock "cinder-4dd125aa-aa20-4522-9483-ed8c367de8d8-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:00:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] Lock "cinder-4dd125aa-aa20-4522-9483-ed8c367de8d8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:00:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] Acquiring lock "cinder-quobyte-4dd125aa-aa20-4522-9483-ed8c367de8d8" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:00:15 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] Lock "cinder-quobyte-4dd125aa-aa20-4522-9483-ed8c367de8d8" acquired by "delete_volume" :: waited 0.014s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:00:15 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aff2ea-aba3-4062-a052-48a9f83be192]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:00:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd125aa-aa20-4522-9483-ed8c367de8d8 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:00:15 devstack sudo[109654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd125aa-aa20-4522-9483-ed8c367de8d8 Jun 16 09:00:15 devstack sudo[109654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:00:15 devstack sudo[109654]: pam_unix(sudo:session): session closed for user root Jun 16 09:00:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd125aa-aa20-4522-9483-ed8c367de8d8" returned: 0 in 0.708s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:00:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd125aa-aa20-4522-9483-ed8c367de8d8 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:00:15 devstack sudo[109659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd125aa-aa20-4522-9483-ed8c367de8d8 Jun 16 09:00:15 devstack sudo[109659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:00:16 devstack sudo[109659]: pam_unix(sudo:session): session closed for user root Jun 16 09:00:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-4dd125aa-aa20-4522-9483-ed8c367de8d8" returned: 0 in 0.601s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:00:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] Lock "cinder-quobyte-4dd125aa-aa20-4522-9483-ed8c367de8d8" released by "delete_volume" :: held 1.345s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:00:16 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] Created reservations ['d32cd11d-afa7-471b-8098-e7efa9b8f9d5', 'aef50480-36bc-4b09-9842-33282d437c10', '8f4d390a-a97f-4212-8252-699eb66b6ecb', 'cc872380-d552-4b0c-91bf-e5d8ff1bb563'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:00:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:00:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:00:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:00:16 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:00:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:00:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:00:16 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:00:16 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:00:17 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.584s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:00:17 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] Deleted volume successfully. Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-61d7ce87-86a4-452f-99a3-8b426c182953 tempest-VolumesTransfersTest-435350716 None] Lock "cinder-4dd125aa-aa20-4522-9483-ed8c367de8d8-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Flow 'volume_create_manager' (9124c069-9291-447c-b368-889cc8056ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e70141-d331-4bd7-aee0-2e9ed17365f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e70141-d331-4bd7-aee0-2e9ed17365f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1946350287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac469fb6-6c8d-44a3-b6c9-6221cfc53e67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fe5a576651472497a6048dadd7b307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:00:18Z,use_quota=True,user_id='996ccf90f1734addb8bf701a3fe50bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516eacb7-9cbc-4bd5-8be7-5a7bd16c4646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516eacb7-9cbc-4bd5-8be7-5a7bd16c4646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0ec9db-b704-4848-8284-f7007e34f6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0ec9db-b704-4848-8284-f7007e34f6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac469fb6-6c8d-44a3-b6c9-6221cfc53e67', 'volume_name': 'volume-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82f6bae-ce2c-4cd3-8bb7-a23cf1a07031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82f6bae-ce2c-4cd3-8bb7-a23cf1a07031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70310fb1-678e-4632-8327-8d603851331b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:17 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Volume ac469fb6-6c8d-44a3-b6c9-6221cfc53e67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67', 'volume_size': 1} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1946350287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac469fb6-6c8d-44a3-b6c9-6221cfc53e67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fe5a576651472497a6048dadd7b307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:00:18Z,use_quota=True,user_id='996ccf90f1734addb8bf701a3fe50bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Creating volume ac469fb6-6c8d-44a3-b6c9-6221cfc53e67 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:00:17 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:00:17 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:00:17 devstack sudo[109665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67 1073741824 Jun 16 09:00:17 devstack sudo[109665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:00:18 devstack sudo[109665]: pam_unix(sudo:session): session closed for user root Jun 16 09:00:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67 1073741824" returned: 0 in 0.751s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:00:18 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:00:18 devstack sudo[109670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67 Jun 16 09:00:18 devstack sudo[109670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:00:19 devstack sudo[109670]: pam_unix(sudo:session): session closed for user root Jun 16 09:00:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67" returned: 0 in 0.591s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:00:19 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:00:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:00:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70310fb1-678e-4632-8327-8d603851331b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bca12b-d1f7-4a8a-939b-51998756b768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:19 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Volume volume-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67 (ac469fb6-6c8d-44a3-b6c9-6221cfc53e67): created successfully Jun 16 09:00:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bca12b-d1f7-4a8a-939b-51998756b768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:19 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Flow 'volume_create_manager' (9124c069-9291-447c-b368-889cc8056ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:00:19 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-67c8ab84-b775-43bb-80f4-8cbc2384819e tempest-VolumesTransfersTest-1187061713 None] Created volume successfully. Jun 16 09:00:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] Acquiring lock "cinder-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:00:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] Lock "cinder-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:00:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] Acquiring lock "cinder-quobyte-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:00:20 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] Lock "cinder-quobyte-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67" acquired by "delete_volume" :: waited 0.013s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:00:20 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f16d02-0f70-4cc5-a24f-019eeab8bb0e]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:00:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:00:20 devstack sudo[109674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67 Jun 16 09:00:20 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:00:20 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root Jun 16 09:00:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67" returned: 0 in 0.699s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:00:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:00:20 devstack sudo[109679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67 Jun 16 09:00:20 devstack sudo[109679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:00:21 devstack sudo[109679]: pam_unix(sudo:session): session closed for user root Jun 16 09:00:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67" returned: 0 in 0.575s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:00:21 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] Lock "cinder-quobyte-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67" released by "delete_volume" :: held 1.309s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:00:21 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] Created reservations ['45793b42-75ac-46d2-848c-13d1f04cf160', '0101c463-75ac-44fd-acbb-784a33454e6f', '9a981a7e-3e84-4b38-a0f5-b0682b9326b6', 'e8f559d7-ec43-4533-bac1-b819daa7d68d'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:00:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:00:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:00:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:00:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:00:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:00:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:00:21 devstack sudo[109682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:00:21 devstack sudo[109682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:00:22 devstack sudo[109682]: pam_unix(sudo:session): session closed for user root Jun 16 09:00:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.591s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:00:22 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:00:22 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] Deleted volume successfully. Jun 16 09:00:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bae0471e-6a67-499c-8cee-b6f33f3617bc tempest-VolumesTransfersTest-435350716 None] Lock "cinder-ac469fb6-6c8d-44a3-b6c9-6221cfc53e67-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Flow 'volume_create_manager' (1af7d620-5e2b-4a49-943b-08a5b64c441a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fe70c6-e24a-4267-90eb-d98e73f336ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fe70c6-e24a-4267-90eb-d98e73f336ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-296769596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8301bd-52d0-4aaf-8c89-ed8be11551fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509d10ac99fd40128d1473950fa63c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:00:27Z,use_quota=True,user_id='ada4c7f5b936469cbfefde9d5c4302b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580269b8-0a3f-4223-a4d3-637449379bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580269b8-0a3f-4223-a4d3-637449379bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294a2ad1-d1e5-4e6d-8b29-b68fdb988b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294a2ad1-d1e5-4e6d-8b29-b68fdb988b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8301bd-52d0-4aaf-8c89-ed8be11551fb', 'volume_name': 'volume-3d8301bd-52d0-4aaf-8c89-ed8be11551fb', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc130bdd-322b-487b-90a3-8b02e60fd4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc130bdd-322b-487b-90a3-8b02e60fd4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61477140-a261-450a-8e67-b497f5ddcd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:26 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Volume 3d8301bd-52d0-4aaf-8c89-ed8be11551fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8301bd-52d0-4aaf-8c89-ed8be11551fb', 'volume_size': 1} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-296769596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8301bd-52d0-4aaf-8c89-ed8be11551fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='509d10ac99fd40128d1473950fa63c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:00:27Z,use_quota=True,user_id='ada4c7f5b936469cbfefde9d5c4302b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Creating volume 3d8301bd-52d0-4aaf-8c89-ed8be11551fb {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:00:26 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:00:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3d8301bd-52d0-4aaf-8c89-ed8be11551fb 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:00:26 devstack sudo[109686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3d8301bd-52d0-4aaf-8c89-ed8be11551fb 1073741824 Jun 16 09:00:26 devstack sudo[109686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:00:27 devstack sudo[109686]: pam_unix(sudo:session): session closed for user root Jun 16 09:00:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3d8301bd-52d0-4aaf-8c89-ed8be11551fb 1073741824" returned: 0 in 0.737s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:00:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3d8301bd-52d0-4aaf-8c89-ed8be11551fb {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:00:27 devstack sudo[109691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3d8301bd-52d0-4aaf-8c89-ed8be11551fb Jun 16 09:00:27 devstack sudo[109691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:00:28 devstack sudo[109691]: pam_unix(sudo:session): session closed for user root Jun 16 09:00:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3d8301bd-52d0-4aaf-8c89-ed8be11551fb" returned: 0 in 0.593s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:00:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:00:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:00:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61477140-a261-450a-8e67-b497f5ddcd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8301bd-52d0-4aaf-8c89-ed8be11551fb', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e655f9c-d88c-4a09-91a6-f8ba34609808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:00:28 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Volume volume-3d8301bd-52d0-4aaf-8c89-ed8be11551fb (3d8301bd-52d0-4aaf-8c89-ed8be11551fb): created successfully Jun 16 09:00:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e655f9c-d88c-4a09-91a6-f8ba34609808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:00:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Flow 'volume_create_manager' (1af7d620-5e2b-4a49-943b-08a5b64c441a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:00:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-971f2687-38b9-4d18-a025-51e75255649e tempest-VolumesNegativeTest-1889159593 None] Created volume successfully. Jun 16 09:00:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 09:00:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:00:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:00:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:00:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:00:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:00:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:00:30 devstack sudo[109698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:00:30 devstack sudo[109698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:00:30 devstack sudo[109698]: pam_unix(sudo:session): session closed for user root Jun 16 09:00:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.593s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:00:30 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:00:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 09:00:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 09:00:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 09:00:38 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=17,cinder:UPDATE=28,cinder:INSERT=4,cinder:DELETE=1 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 09:00:38 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=16,cinder:UPDATE=22,cinder:INSERT=7,cinder:DELETE=4 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 09:00:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] Acquiring lock "cinder-3d8301bd-52d0-4aaf-8c89-ed8be11551fb-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:00:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] Lock "cinder-3d8301bd-52d0-4aaf-8c89-ed8be11551fb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:00:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] Acquiring lock "cinder-quobyte-3d8301bd-52d0-4aaf-8c89-ed8be11551fb" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:00:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] Lock "cinder-quobyte-3d8301bd-52d0-4aaf-8c89-ed8be11551fb" acquired by "delete_volume" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:00:56 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[649cad39-1f3d-4994-8ca7-927c91e63da7]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:00:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3d8301bd-52d0-4aaf-8c89-ed8be11551fb {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:00:56 devstack sudo[109840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3d8301bd-52d0-4aaf-8c89-ed8be11551fb Jun 16 09:00:56 devstack sudo[109840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:00:57 devstack sudo[109840]: pam_unix(sudo:session): session closed for user root Jun 16 09:00:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3d8301bd-52d0-4aaf-8c89-ed8be11551fb" returned: 0 in 0.687s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:00:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3d8301bd-52d0-4aaf-8c89-ed8be11551fb {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:00:57 devstack sudo[109845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3d8301bd-52d0-4aaf-8c89-ed8be11551fb Jun 16 09:00:57 devstack sudo[109845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:00:58 devstack sudo[109845]: pam_unix(sudo:session): session closed for user root Jun 16 09:00:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-3d8301bd-52d0-4aaf-8c89-ed8be11551fb" returned: 0 in 0.572s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:00:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] Lock "cinder-quobyte-3d8301bd-52d0-4aaf-8c89-ed8be11551fb" released by "delete_volume" :: held 1.298s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:00:58 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] Created reservations ['3ca5558d-9bd2-4e74-89c7-568241d61930', '6ca0a85d-78f2-408c-8ab9-fc32c7b008cb', 'f8231f88-ac1a-44c5-ba6b-0a9efa14f5d7', '0bdbe2be-3280-4092-aa13-f3447cc10827'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:00:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:00:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:00:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:00:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:00:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:00:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:00:58 devstack sudo[109848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:00:58 devstack sudo[109848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:00:58 devstack sudo[109848]: pam_unix(sudo:session): session closed for user root Jun 16 09:00:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.608s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:00:58 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:00:58 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] Deleted volume successfully. Jun 16 09:00:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-2c985ea4-5522-4937-ae94-df39aedaf169 tempest-VolumesNegativeTest-1889159593 None] Lock "cinder-3d8301bd-52d0-4aaf-8c89-ed8be11551fb-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:01:08 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 09:01:08 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 09:01:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 09:01:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:01:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:01:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:01:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:01:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:01:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:01:30 devstack sudo[109921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:01:30 devstack sudo[109921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:01:30 devstack sudo[109921]: pam_unix(sudo:session): session closed for user root Jun 16 09:01:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.611s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:01:30 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:01:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 09:01:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 09:01:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Flow 'volume_create_manager' (fac73d84-9704-40e7-8d75-0196e55aaa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4a0935-27e2-4014-a382-ab3e2a5bdde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4a0935-27e2-4014-a382-ab3e2a5bdde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1165500590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52bfd831-87e3-4f65-8954-d15b8853f12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee038555df04393aafa741eaedef0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:01:38Z,use_quota=True,user_id='3f019da884204f0b9a3424e25e7c4521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b0351f-070a-4a4a-92dd-cb0cd8ab24ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b0351f-070a-4a4a-92dd-cb0cd8ab24ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ec6803-1b22-4c60-ba67-0823fe032957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ec6803-1b22-4c60-ba67-0823fe032957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52bfd831-87e3-4f65-8954-d15b8853f12f', 'volume_name': 'volume-52bfd831-87e3-4f65-8954-d15b8853f12f', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f3a1f6-c96b-443b-9683-a495ef83ed46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f3a1f6-c96b-443b-9683-a495ef83ed46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6347dd2d-6e5b-4c67-b2b3-40781d88d668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:01:38 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Volume 52bfd831-87e3-4f65-8954-d15b8853f12f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52bfd831-87e3-4f65-8954-d15b8853f12f', 'volume_size': 1} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1165500590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52bfd831-87e3-4f65-8954-d15b8853f12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee038555df04393aafa741eaedef0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:01:38Z,use_quota=True,user_id='3f019da884204f0b9a3424e25e7c4521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Creating volume 52bfd831-87e3-4f65-8954-d15b8853f12f {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:01:38 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-52bfd831-87e3-4f65-8954-d15b8853f12f 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:01:38 devstack sudo[109999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-52bfd831-87e3-4f65-8954-d15b8853f12f 1073741824 Jun 16 09:01:38 devstack sudo[109999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:01:38 devstack sudo[109999]: pam_unix(sudo:session): session closed for user root Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-52bfd831-87e3-4f65-8954-d15b8853f12f 1073741824" returned: 0 in 0.814s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:01:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-52bfd831-87e3-4f65-8954-d15b8853f12f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:01:38 devstack sudo[110005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-52bfd831-87e3-4f65-8954-d15b8853f12f Jun 16 09:01:38 devstack sudo[110005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:01:39 devstack sudo[110005]: pam_unix(sudo:session): session closed for user root Jun 16 09:01:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-52bfd831-87e3-4f65-8954-d15b8853f12f" returned: 0 in 0.589s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:01:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:01:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:01:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6347dd2d-6e5b-4c67-b2b3-40781d88d668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52bfd831-87e3-4f65-8954-d15b8853f12f', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:01:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1d6bbb-7309-468a-bda5-b42416c9576e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:01:39 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Volume volume-52bfd831-87e3-4f65-8954-d15b8853f12f (52bfd831-87e3-4f65-8954-d15b8853f12f): created successfully Jun 16 09:01:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1d6bbb-7309-468a-bda5-b42416c9576e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:01:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Flow 'volume_create_manager' (fac73d84-9704-40e7-8d75-0196e55aaa92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:01:39 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4f816822-3c3f-4ac3-9dbc-304e4a89e346 tempest-TestMinimumBasicScenario-1338867846 None] Created volume successfully. Jun 16 09:01:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-f8eff094-d495-455f-afe4-1a4455ad904f req-329745a0-3793-499f-92c7-4d59ad87e15e tempest-TestMinimumBasicScenario-1338867846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:01:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-f8eff094-d495-455f-afe4-1a4455ad904f req-329745a0-3793-499f-92c7-4d59ad87e15e tempest-TestMinimumBasicScenario-1338867846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:01:43 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d94e10-5005-4efe-9840-4b6e5b6e7c32]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:01:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-f8eff094-d495-455f-afe4-1a4455ad904f req-329745a0-3793-499f-92c7-4d59ad87e15e tempest-TestMinimumBasicScenario-1338867846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-52bfd831-87e3-4f65-8954-d15b8853f12f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:01:43 devstack sudo[110016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-52bfd831-87e3-4f65-8954-d15b8853f12f Jun 16 09:01:43 devstack sudo[110016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:01:44 devstack sudo[110016]: pam_unix(sudo:session): session closed for user root Jun 16 09:01:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [req-f8eff094-d495-455f-afe4-1a4455ad904f req-329745a0-3793-499f-92c7-4d59ad87e15e tempest-TestMinimumBasicScenario-1338867846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-52bfd831-87e3-4f65-8954-d15b8853f12f" returned: 0 in 0.818s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:01:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [req-f8eff094-d495-455f-afe4-1a4455ad904f req-329745a0-3793-499f-92c7-4d59ad87e15e tempest-TestMinimumBasicScenario-1338867846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.837s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:01:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-f8eff094-d495-455f-afe4-1a4455ad904f req-329745a0-3793-499f-92c7-4d59ad87e15e tempest-TestMinimumBasicScenario-1338867846 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6', 'name': 'volume-52bfd831-87e3-4f65-8954-d15b8853f12f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7fb22bff-df92-4138-8e9b-e474d8d7b855', 'enforce_multipath': True} {{(pid=92348) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 16 09:01:44 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-f8eff094-d495-455f-afe4-1a4455ad904f req-329745a0-3793-499f-92c7-4d59ad87e15e tempest-TestMinimumBasicScenario-1338867846 None] attachment_update completed successfully. Jun 16 09:01:54 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 09:01:54 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 09:02:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [req-62aaab60-534e-45cc-a7fd-5c869b07e9d7 req-f8ef363a-dc5b-4c87-8383-f453a9df0d7c tempest-TestMinimumBasicScenario-1338867846 None] Terminate volume connection completed successfully. Jun 16 09:02:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [req-62aaab60-534e-45cc-a7fd-5c869b07e9d7 req-f8ef363a-dc5b-4c87-8383-f453a9df0d7c tempest-TestMinimumBasicScenario-1338867846 None] Deleting attachment 7fb22bff-df92-4138-8e9b-e474d8d7b855. {{(pid=92348) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:30 devstack sudo[110636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:02:30 devstack sudo[110636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] Acquiring lock "cinder-52bfd831-87e3-4f65-8954-d15b8853f12f-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] Lock "cinder-52bfd831-87e3-4f65-8954-d15b8853f12f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] Acquiring lock "cinder-quobyte-52bfd831-87e3-4f65-8954-d15b8853f12f" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] Lock "cinder-quobyte-52bfd831-87e3-4f65-8954-d15b8853f12f" acquired by "delete_volume" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d5f7b3-90ce-44bb-bcdb-8001a967f359]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-52bfd831-87e3-4f65-8954-d15b8853f12f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:30 devstack sudo[110638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-52bfd831-87e3-4f65-8954-d15b8853f12f Jun 16 09:02:30 devstack sudo[110638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:02:30 devstack sudo[110636]: pam_unix(sudo:session): session closed for user root Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.642s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 09:02:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 09:02:31 devstack sudo[110638]: pam_unix(sudo:session): session closed for user root Jun 16 09:02:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-52bfd831-87e3-4f65-8954-d15b8853f12f" returned: 0 in 0.735s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:02:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-52bfd831-87e3-4f65-8954-d15b8853f12f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:31 devstack sudo[110644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-52bfd831-87e3-4f65-8954-d15b8853f12f Jun 16 09:02:31 devstack sudo[110644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:02:31 devstack sudo[110644]: pam_unix(sudo:session): session closed for user root Jun 16 09:02:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-52bfd831-87e3-4f65-8954-d15b8853f12f" returned: 0 in 0.599s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:02:31 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] Lock "cinder-quobyte-52bfd831-87e3-4f65-8954-d15b8853f12f" released by "delete_volume" :: held 1.373s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:02:31 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] Created reservations ['cfdd8528-710d-47e0-a50f-554c3126518d', '8ca5fe15-fff1-451d-b837-824f0d793e28', '52430b43-33be-4526-88fd-215e7e3cb84d', 'ab09c5c8-7244-4e47-a2bb-01024a07c3c8'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:02:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:02:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:02:31 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:02:31 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:02:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:02:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:31 devstack sudo[110647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:02:31 devstack sudo[110647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:02:32 devstack sudo[110647]: pam_unix(sudo:session): session closed for user root Jun 16 09:02:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.617s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:02:32 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:02:32 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] Deleted volume successfully. Jun 16 09:02:32 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-02508a6d-67a4-4251-869f-eaf7d0fee372 tempest-TestMinimumBasicScenario-1338867846 None] Lock "cinder-52bfd831-87e3-4f65-8954-d15b8853f12f-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:02:41 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 09:02:42 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Flow 'volume_create_manager' (52e1840d-d30b-4e24-a34a-7868f34ae49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204a8a7b-4d1e-43bf-a95d-a42ec5175f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204a8a7b-4d1e-43bf-a95d-a42ec5175f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1803573063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c50b9c4-2b75-4787-a616-55fd9f5fd302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca2c040ac444c0c90051f8bdc868359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:02:48Z,use_quota=True,user_id='6e97be8e39bd48f2b339e406ee4f3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2f4116-ed08-4c41-97bb-8ea5824b5a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2f4116-ed08-4c41-97bb-8ea5824b5a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f327f4-c1af-4a96-87ae-c891d7f3dbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f327f4-c1af-4a96-87ae-c891d7f3dbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c50b9c4-2b75-4787-a616-55fd9f5fd302', 'volume_name': 'volume-9c50b9c4-2b75-4787-a616-55fd9f5fd302', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667d503d-7ace-4d8c-9b2b-0ca4534a56d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667d503d-7ace-4d8c-9b2b-0ca4534a56d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e69f20-5f5d-4ac5-a511-095fc02baaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:48 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume 9c50b9c4-2b75-4787-a616-55fd9f5fd302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c50b9c4-2b75-4787-a616-55fd9f5fd302', 'volume_size': 1} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1803573063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c50b9c4-2b75-4787-a616-55fd9f5fd302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca2c040ac444c0c90051f8bdc868359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:02:48Z,use_quota=True,user_id='6e97be8e39bd48f2b339e406ee4f3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Creating volume 9c50b9c4-2b75-4787-a616-55fd9f5fd302 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:02:48 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:02:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9c50b9c4-2b75-4787-a616-55fd9f5fd302 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:48 devstack sudo[110698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9c50b9c4-2b75-4787-a616-55fd9f5fd302 1073741824 Jun 16 09:02:48 devstack sudo[110698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:02:49 devstack sudo[110698]: pam_unix(sudo:session): session closed for user root Jun 16 09:02:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9c50b9c4-2b75-4787-a616-55fd9f5fd302 1073741824" returned: 0 in 0.760s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:02:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9c50b9c4-2b75-4787-a616-55fd9f5fd302 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:49 devstack sudo[110705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9c50b9c4-2b75-4787-a616-55fd9f5fd302 Jun 16 09:02:49 devstack sudo[110705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:02:49 devstack sudo[110705]: pam_unix(sudo:session): session closed for user root Jun 16 09:02:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9c50b9c4-2b75-4787-a616-55fd9f5fd302" returned: 0 in 0.596s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:02:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:02:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:02:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e69f20-5f5d-4ac5-a511-095fc02baaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c50b9c4-2b75-4787-a616-55fd9f5fd302', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec3e57f-5929-486f-836a-509f17541e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:49 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume volume-9c50b9c4-2b75-4787-a616-55fd9f5fd302 (9c50b9c4-2b75-4787-a616-55fd9f5fd302): created successfully Jun 16 09:02:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec3e57f-5929-486f-836a-509f17541e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:49 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Flow 'volume_create_manager' (52e1840d-d30b-4e24-a34a-7868f34ae49e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:02:49 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-73dbe158-52ea-4de2-bcb3-1211bded71a5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Created volume successfully. Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Flow 'volume_create_manager' (2deaca0a-6953-498f-9c58-fcfcb8ae9351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d413f54-73ab-4315-9c9d-2bb8b79da35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d413f54-73ab-4315-9c9d-2bb8b79da35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1390980926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89026d0-7042-4d93-8527-3be0d382498c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca2c040ac444c0c90051f8bdc868359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:02:51Z,use_quota=True,user_id='6e97be8e39bd48f2b339e406ee4f3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b36a3b-f825-45ea-ac11-f5db8a826887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b36a3b-f825-45ea-ac11-f5db8a826887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1341ca05-bbee-4474-817b-ab3f7ca0b675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1341ca05-bbee-4474-817b-ab3f7ca0b675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c89026d0-7042-4d93-8527-3be0d382498c', 'volume_name': 'volume-c89026d0-7042-4d93-8527-3be0d382498c', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b42ce4-e7c3-4c2f-a1d1-f33f0a64007a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b42ce4-e7c3-4c2f-a1d1-f33f0a64007a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (018365cb-788d-4ba2-b77d-b634dff40fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:50 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume c89026d0-7042-4d93-8527-3be0d382498c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c89026d0-7042-4d93-8527-3be0d382498c', 'volume_size': 1} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1390980926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89026d0-7042-4d93-8527-3be0d382498c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca2c040ac444c0c90051f8bdc868359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:02:51Z,use_quota=True,user_id='6e97be8e39bd48f2b339e406ee4f3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Creating volume c89026d0-7042-4d93-8527-3be0d382498c {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:02:50 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:02:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c89026d0-7042-4d93-8527-3be0d382498c 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:50 devstack sudo[110708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c89026d0-7042-4d93-8527-3be0d382498c 1073741824 Jun 16 09:02:50 devstack sudo[110708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Flow 'volume_create_manager' (6981781f-6ccc-49de-9747-a7f8f7bd3faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eca13fc-d167-4e6c-adf2-b201ca3e35bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eca13fc-d167-4e6c-adf2-b201ca3e35bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2005876693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8611411-cb36-4f62-b74a-d80077385050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca2c040ac444c0c90051f8bdc868359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:02:51Z,use_quota=True,user_id='6e97be8e39bd48f2b339e406ee4f3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ac107d-0417-4073-bffe-d947fdbadebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ac107d-0417-4073-bffe-d947fdbadebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01497c32-f24e-4346-8ae1-751758b24adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01497c32-f24e-4346-8ae1-751758b24adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8611411-cb36-4f62-b74a-d80077385050', 'volume_name': 'volume-f8611411-cb36-4f62-b74a-d80077385050', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ae3254-995d-45bc-963e-d131be3eb885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ae3254-995d-45bc-963e-d131be3eb885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439dee9f-3259-4762-81ea-c43e7195b5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:51 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume f8611411-cb36-4f62-b74a-d80077385050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8611411-cb36-4f62-b74a-d80077385050', 'volume_size': 1} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Flow 'volume_create_manager' (71fffd0a-8bbe-48f5-9610-e541c563cceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806e2b0b-9fae-4ef5-89fc-d6859830f4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806e2b0b-9fae-4ef5-89fc-d6859830f4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1383315493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3c9938-a27e-4314-82ef-75eb09682684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca2c040ac444c0c90051f8bdc868359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:02:51Z,use_quota=True,user_id='6e97be8e39bd48f2b339e406ee4f3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (386b40b7-855c-4465-b21b-3771a230cc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (386b40b7-855c-4465-b21b-3771a230cc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09e1ee3-6bef-4ebf-b975-b7c03dc4bd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09e1ee3-6bef-4ebf-b975-b7c03dc4bd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac3c9938-a27e-4314-82ef-75eb09682684', 'volume_name': 'volume-ac3c9938-a27e-4314-82ef-75eb09682684', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff9cb65-2b74-4985-b5cc-da503378f53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff9cb65-2b74-4985-b5cc-da503378f53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c4ff2e0-bdfb-4176-bd80-11f1ef132a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:51 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume ac3c9938-a27e-4314-82ef-75eb09682684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac3c9938-a27e-4314-82ef-75eb09682684', 'volume_size': 1} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:02:51 devstack sudo[110708]: pam_unix(sudo:session): session closed for user root Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c89026d0-7042-4d93-8527-3be0d382498c 1073741824" returned: 0 in 0.847s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c89026d0-7042-4d93-8527-3be0d382498c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:02:51 devstack sudo[110715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c89026d0-7042-4d93-8527-3be0d382498c Jun 16 09:02:51 devstack sudo[110715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Flow 'volume_create_manager' (3ad5e5cc-8a40-4662-bc11-4e7ecec05b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368ee2de-475e-46b3-b6a9-6929190070ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368ee2de-475e-46b3-b6a9-6929190070ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1722470867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59bc9fe-0f18-4da4-bada-0dbcf869ecad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca2c040ac444c0c90051f8bdc868359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:02:52Z,use_quota=True,user_id='6e97be8e39bd48f2b339e406ee4f3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c393d710-d0a1-4664-b875-42060f01bacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c393d710-d0a1-4664-b875-42060f01bacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c80f0a-90be-470e-85f0-bc9b53ce6fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c80f0a-90be-470e-85f0-bc9b53ce6fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e59bc9fe-0f18-4da4-bada-0dbcf869ecad', 'volume_name': 'volume-e59bc9fe-0f18-4da4-bada-0dbcf869ecad', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d970603-e774-4689-b825-2c769fe5b547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d970603-e774-4689-b825-2c769fe5b547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5162899b-22c1-42d0-9b73-81bd1052ea26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:51 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume e59bc9fe-0f18-4da4-bada-0dbcf869ecad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e59bc9fe-0f18-4da4-bada-0dbcf869ecad', 'volume_size': 1} Jun 16 09:02:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Flow 'volume_create_manager' (2ab90c14-92c7-4187-b198-c2c4e1098b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0395dd52-6505-4ba9-99e8-9a1662f4570f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0395dd52-6505-4ba9-99e8-9a1662f4570f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-838148978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=432eb7ca-9ed6-4880-97a7-6cc2e3449866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca2c040ac444c0c90051f8bdc868359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:02:52Z,use_quota=True,user_id='6e97be8e39bd48f2b339e406ee4f3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e782d7c-22db-4b2f-a8f4-003196b3db8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e782d7c-22db-4b2f-a8f4-003196b3db8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957eb7cf-b22d-415e-8290-07e69ced7770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957eb7cf-b22d-415e-8290-07e69ced7770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '432eb7ca-9ed6-4880-97a7-6cc2e3449866', 'volume_name': 'volume-432eb7ca-9ed6-4880-97a7-6cc2e3449866', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4f4659-d0c0-48ba-b477-466a1b26bbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4f4659-d0c0-48ba-b477-466a1b26bbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59d2b01-462c-4e04-abd0-2cc3a4e33aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:52 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume 432eb7ca-9ed6-4880-97a7-6cc2e3449866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-432eb7ca-9ed6-4880-97a7-6cc2e3449866', 'volume_size': 1} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:02:52 devstack sudo[110715]: pam_unix(sudo:session): session closed for user root Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c89026d0-7042-4d93-8527-3be0d382498c" returned: 0 in 0.663s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.255s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2005876693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8611411-cb36-4f62-b74a-d80077385050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca2c040ac444c0c90051f8bdc868359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:02:51Z,use_quota=True,user_id='6e97be8e39bd48f2b339e406ee4f3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Creating volume f8611411-cb36-4f62-b74a-d80077385050 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:02:52 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f8611411-cb36-4f62-b74a-d80077385050 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (018365cb-788d-4ba2-b77d-b634dff40fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c89026d0-7042-4d93-8527-3be0d382498c', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842aaf73-f8fe-4840-b3d2-6200b46715aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:52 devstack sudo[110718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f8611411-cb36-4f62-b74a-d80077385050 1073741824 Jun 16 09:02:52 devstack sudo[110718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:02:52 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume volume-c89026d0-7042-4d93-8527-3be0d382498c (c89026d0-7042-4d93-8527-3be0d382498c): created successfully Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842aaf73-f8fe-4840-b3d2-6200b46715aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Flow 'volume_create_manager' (2deaca0a-6953-498f-9c58-fcfcb8ae9351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:02:52 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-632a1a6d-62c1-41b3-9163-f492a0358cd3 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Created volume successfully. Jun 16 09:02:53 devstack sudo[110718]: pam_unix(sudo:session): session closed for user root Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f8611411-cb36-4f62-b74a-d80077385050 1073741824" returned: 0 in 0.770s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f8611411-cb36-4f62-b74a-d80077385050 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:53 devstack sudo[110723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f8611411-cb36-4f62-b74a-d80077385050 Jun 16 09:02:53 devstack sudo[110723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:02:53 devstack sudo[110723]: pam_unix(sudo:session): session closed for user root Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f8611411-cb36-4f62-b74a-d80077385050" returned: 0 in 0.585s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.324s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1383315493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3c9938-a27e-4314-82ef-75eb09682684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca2c040ac444c0c90051f8bdc868359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:02:51Z,use_quota=True,user_id='6e97be8e39bd48f2b339e406ee4f3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Creating volume ac3c9938-a27e-4314-82ef-75eb09682684 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:02:53 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac3c9938-a27e-4314-82ef-75eb09682684 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439dee9f-3259-4762-81ea-c43e7195b5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8611411-cb36-4f62-b74a-d80077385050', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:53 devstack sudo[110726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac3c9938-a27e-4314-82ef-75eb09682684 1073741824 Jun 16 09:02:53 devstack sudo[110726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca53163-2387-463c-87f2-97c4b7aec415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:53 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume volume-f8611411-cb36-4f62-b74a-d80077385050 (f8611411-cb36-4f62-b74a-d80077385050): created successfully Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca53163-2387-463c-87f2-97c4b7aec415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Flow 'volume_create_manager' (6981781f-6ccc-49de-9747-a7f8f7bd3faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:02:53 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-becaa129-f42e-42da-ab5f-90677f4ab82d tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Created volume successfully. Jun 16 09:02:54 devstack sudo[110726]: pam_unix(sudo:session): session closed for user root Jun 16 09:02:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac3c9938-a27e-4314-82ef-75eb09682684 1073741824" returned: 0 in 0.797s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:02:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac3c9938-a27e-4314-82ef-75eb09682684 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:54 devstack sudo[110732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac3c9938-a27e-4314-82ef-75eb09682684 Jun 16 09:02:54 devstack sudo[110732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:02:55 devstack sudo[110732]: pam_unix(sudo:session): session closed for user root Jun 16 09:02:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac3c9938-a27e-4314-82ef-75eb09682684" returned: 0 in 0.599s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:02:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:02:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:02:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.408s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:02:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1722470867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59bc9fe-0f18-4da4-bada-0dbcf869ecad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca2c040ac444c0c90051f8bdc868359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:02:52Z,use_quota=True,user_id='6e97be8e39bd48f2b339e406ee4f3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:02:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Creating volume e59bc9fe-0f18-4da4-bada-0dbcf869ecad {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:02:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:02:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:02:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:02:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:02:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:02:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:02:55 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:02:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e59bc9fe-0f18-4da4-bada-0dbcf869ecad 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c4ff2e0-bdfb-4176-bd80-11f1ef132a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac3c9938-a27e-4314-82ef-75eb09682684', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:55 devstack sudo[110735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e59bc9fe-0f18-4da4-bada-0dbcf869ecad 1073741824 Jun 16 09:02:55 devstack sudo[110735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:02:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf1c236-aaa3-4fb1-9503-9551c99f84e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:55 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume volume-ac3c9938-a27e-4314-82ef-75eb09682684 (ac3c9938-a27e-4314-82ef-75eb09682684): created successfully Jun 16 09:02:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf1c236-aaa3-4fb1-9503-9551c99f84e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Flow 'volume_create_manager' (71fffd0a-8bbe-48f5-9610-e541c563cceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:02:55 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-6734b444-1e71-4c88-ba20-f5ecc10c4160 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Created volume successfully. Jun 16 09:02:56 devstack sudo[110735]: pam_unix(sudo:session): session closed for user root Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e59bc9fe-0f18-4da4-bada-0dbcf869ecad 1073741824" returned: 0 in 0.794s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e59bc9fe-0f18-4da4-bada-0dbcf869ecad {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:56 devstack sudo[110743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e59bc9fe-0f18-4da4-bada-0dbcf869ecad Jun 16 09:02:56 devstack sudo[110743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:02:56 devstack sudo[110743]: pam_unix(sudo:session): session closed for user root Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e59bc9fe-0f18-4da4-bada-0dbcf869ecad" returned: 0 in 0.627s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.556s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-838148978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=432eb7ca-9ed6-4880-97a7-6cc2e3449866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca2c040ac444c0c90051f8bdc868359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:02:52Z,use_quota=True,user_id='6e97be8e39bd48f2b339e406ee4f3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Creating volume 432eb7ca-9ed6-4880-97a7-6cc2e3449866 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:02:56 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-432eb7ca-9ed6-4880-97a7-6cc2e3449866 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5162899b-22c1-42d0-9b73-81bd1052ea26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e59bc9fe-0f18-4da4-bada-0dbcf869ecad', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:56 devstack sudo[110752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-432eb7ca-9ed6-4880-97a7-6cc2e3449866 1073741824 Jun 16 09:02:56 devstack sudo[110752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf8c047-e09d-4dea-adea-aefabc7f78e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:56 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume volume-e59bc9fe-0f18-4da4-bada-0dbcf869ecad (e59bc9fe-0f18-4da4-bada-0dbcf869ecad): created successfully Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf8c047-e09d-4dea-adea-aefabc7f78e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:56 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Flow 'volume_create_manager' (3ad5e5cc-8a40-4662-bc11-4e7ecec05b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:02:56 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-863c81cc-cab7-4a6b-b7ed-c4d6c329cab5 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Created volume successfully. Jun 16 09:02:57 devstack sudo[110752]: pam_unix(sudo:session): session closed for user root Jun 16 09:02:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-432eb7ca-9ed6-4880-97a7-6cc2e3449866 1073741824" returned: 0 in 0.797s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:02:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-432eb7ca-9ed6-4880-97a7-6cc2e3449866 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:57 devstack sudo[110757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-432eb7ca-9ed6-4880-97a7-6cc2e3449866 Jun 16 09:02:57 devstack sudo[110757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:02:58 devstack sudo[110757]: pam_unix(sudo:session): session closed for user root Jun 16 09:02:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-432eb7ca-9ed6-4880-97a7-6cc2e3449866" returned: 0 in 0.609s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:02:58 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:02:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:02:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59d2b01-462c-4e04-abd0-2cc3a4e33aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-432eb7ca-9ed6-4880-97a7-6cc2e3449866', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce85eb67-cf88-43e6-b2bb-cc3a797f9b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:02:58 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Volume volume-432eb7ca-9ed6-4880-97a7-6cc2e3449866 (432eb7ca-9ed6-4880-97a7-6cc2e3449866): created successfully Jun 16 09:02:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce85eb67-cf88-43e6-b2bb-cc3a797f9b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:02:58 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Flow 'volume_create_manager' (2ab90c14-92c7-4187-b198-c2c4e1098b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:02:58 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-9cf1a5d8-480b-439a-aad4-68aecbe0007b tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Created volume successfully. Jun 16 09:02:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "cinder-432eb7ca-9ed6-4880-97a7-6cc2e3449866-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:02:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-432eb7ca-9ed6-4880-97a7-6cc2e3449866-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:02:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "cinder-quobyte-432eb7ca-9ed6-4880-97a7-6cc2e3449866" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:02:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-quobyte-432eb7ca-9ed6-4880-97a7-6cc2e3449866" acquired by "delete_volume" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:02:58 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4169fb88-e56e-4fc6-942f-3f988c2ec2ce]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:02:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-432eb7ca-9ed6-4880-97a7-6cc2e3449866 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:58 devstack sudo[110761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-432eb7ca-9ed6-4880-97a7-6cc2e3449866 Jun 16 09:02:58 devstack sudo[110761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:02:59 devstack sudo[110761]: pam_unix(sudo:session): session closed for user root Jun 16 09:02:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-432eb7ca-9ed6-4880-97a7-6cc2e3449866" returned: 0 in 0.750s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:02:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-432eb7ca-9ed6-4880-97a7-6cc2e3449866 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:02:59 devstack sudo[110766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-432eb7ca-9ed6-4880-97a7-6cc2e3449866 Jun 16 09:02:59 devstack sudo[110766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:00 devstack sudo[110766]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-432eb7ca-9ed6-4880-97a7-6cc2e3449866" returned: 0 in 0.596s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-quobyte-432eb7ca-9ed6-4880-97a7-6cc2e3449866" released by "delete_volume" :: held 1.391s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:00 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Created reservations ['7d4e3545-26ba-46a8-87c8-d077865a951c', '1739a2f7-6af1-4362-8fad-6001097113e3', '09792028-61dd-4102-8930-a696744f1713', 'f61a926e-a9e6-4118-ac83-3a117da2442f'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:03:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:00 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:00 devstack sudo[110769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:00 devstack sudo[110769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:00 devstack sudo[110769]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.611s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:00 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:00 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Deleted volume successfully. Jun 16 09:03:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-50f4510d-5792-4af9-b746-a4a9cedd67e7 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-432eb7ca-9ed6-4880-97a7-6cc2e3449866-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "cinder-e59bc9fe-0f18-4da4-bada-0dbcf869ecad-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-e59bc9fe-0f18-4da4-bada-0dbcf869ecad-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "cinder-quobyte-e59bc9fe-0f18-4da4-bada-0dbcf869ecad" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:01 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-quobyte-e59bc9fe-0f18-4da4-bada-0dbcf869ecad" acquired by "delete_volume" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:01 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eb110c-90d8-44a8-ac8a-2dc1d4f935b1]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e59bc9fe-0f18-4da4-bada-0dbcf869ecad {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:01 devstack sudo[110772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e59bc9fe-0f18-4da4-bada-0dbcf869ecad Jun 16 09:03:01 devstack sudo[110772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:01 devstack sudo[110772]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e59bc9fe-0f18-4da4-bada-0dbcf869ecad" returned: 0 in 0.714s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e59bc9fe-0f18-4da4-bada-0dbcf869ecad {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:01 devstack sudo[110777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e59bc9fe-0f18-4da4-bada-0dbcf869ecad Jun 16 09:03:01 devstack sudo[110777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:02 devstack sudo[110777]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e59bc9fe-0f18-4da4-bada-0dbcf869ecad" returned: 0 in 0.596s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-quobyte-e59bc9fe-0f18-4da4-bada-0dbcf869ecad" released by "delete_volume" :: held 1.348s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:02 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Created reservations ['762f8abb-9320-41c6-958a-e8acf3b3eaf4', '4cd5b62d-29d4-453d-b801-1646cd79acbd', '74c40cfb-c2ed-4d93-ac37-0b1e39ab0c11', 'ac22a598-443d-41f3-8bf4-c927f538c9bb'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:03:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:02 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:02 devstack sudo[110780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:02 devstack sudo[110780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:03 devstack sudo[110780]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.604s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:03 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:03 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Deleted volume successfully. Jun 16 09:03:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-3d8fe092-de02-4e5b-a3a0-b9be716b29fa tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-e59bc9fe-0f18-4da4-bada-0dbcf869ecad-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "cinder-ac3c9938-a27e-4314-82ef-75eb09682684-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-ac3c9938-a27e-4314-82ef-75eb09682684-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "cinder-quobyte-ac3c9938-a27e-4314-82ef-75eb09682684" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:03 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-quobyte-ac3c9938-a27e-4314-82ef-75eb09682684" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:03 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d58bf59-4b3d-4461-b26b-e95476ad68dd]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac3c9938-a27e-4314-82ef-75eb09682684 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:03 devstack sudo[110783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac3c9938-a27e-4314-82ef-75eb09682684 Jun 16 09:03:03 devstack sudo[110783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:03 devstack sudo[110783]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac3c9938-a27e-4314-82ef-75eb09682684" returned: 0 in 0.710s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:03 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac3c9938-a27e-4314-82ef-75eb09682684 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:03 devstack sudo[110788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac3c9938-a27e-4314-82ef-75eb09682684 Jun 16 09:03:03 devstack sudo[110788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:04 devstack sudo[110788]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-ac3c9938-a27e-4314-82ef-75eb09682684" returned: 0 in 0.609s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:04 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-quobyte-ac3c9938-a27e-4314-82ef-75eb09682684" released by "delete_volume" :: held 1.358s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:04 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Created reservations ['b62db85d-49da-44d4-b342-146faac41562', 'b708b8d5-c004-4bb7-b44e-c86b99c238d0', 'ed3418c7-42f4-4ceb-8365-da2c265a2295', 'a2e148c5-6bdb-4175-981c-460800d29f84'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:03:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:04 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:04 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:04 devstack sudo[110791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:04 devstack sudo[110791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:05 devstack sudo[110791]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.594s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:05 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:05 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Deleted volume successfully. Jun 16 09:03:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4cdab786-86e1-42c4-9903-3a3a4ff9ee51 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-ac3c9938-a27e-4314-82ef-75eb09682684-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "cinder-f8611411-cb36-4f62-b74a-d80077385050-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-f8611411-cb36-4f62-b74a-d80077385050-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "cinder-quobyte-f8611411-cb36-4f62-b74a-d80077385050" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-quobyte-f8611411-cb36-4f62-b74a-d80077385050" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:05 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[676bd0a1-3d9d-447a-bd1c-698a70c8dd5c]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f8611411-cb36-4f62-b74a-d80077385050 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:05 devstack sudo[110794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f8611411-cb36-4f62-b74a-d80077385050 Jun 16 09:03:05 devstack sudo[110794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:06 devstack sudo[110794]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f8611411-cb36-4f62-b74a-d80077385050" returned: 0 in 0.698s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f8611411-cb36-4f62-b74a-d80077385050 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:06 devstack sudo[110799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f8611411-cb36-4f62-b74a-d80077385050 Jun 16 09:03:06 devstack sudo[110799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:06 devstack sudo[110799]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-f8611411-cb36-4f62-b74a-d80077385050" returned: 0 in 0.603s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-quobyte-f8611411-cb36-4f62-b74a-d80077385050" released by "delete_volume" :: held 1.342s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:06 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Created reservations ['2976e154-0341-42e3-8519-9a6c7ee1aa8b', '199e8fae-a11f-46fd-a8b9-bb8f810c5976', 'd2ed9a91-e982-4f22-aa82-a4e2fe523438', '71299344-a0ea-4da0-940c-b99fbd0edc93'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:03:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:06 devstack sudo[110802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:06 devstack sudo[110802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:07 devstack sudo[110802]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.592s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:07 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:07 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Deleted volume successfully. Jun 16 09:03:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6a352745-e0e4-426b-9703-b4049eb873fd tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-f8611411-cb36-4f62-b74a-d80077385050-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "cinder-c89026d0-7042-4d93-8527-3be0d382498c-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-c89026d0-7042-4d93-8527-3be0d382498c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "cinder-quobyte-c89026d0-7042-4d93-8527-3be0d382498c" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:07 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-quobyte-c89026d0-7042-4d93-8527-3be0d382498c" acquired by "delete_volume" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:07 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[48890644-7bc1-44c6-ab7c-154ec06d798c]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c89026d0-7042-4d93-8527-3be0d382498c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:07 devstack sudo[110805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c89026d0-7042-4d93-8527-3be0d382498c Jun 16 09:03:07 devstack sudo[110805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:08 devstack sudo[110805]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c89026d0-7042-4d93-8527-3be0d382498c" returned: 0 in 0.692s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c89026d0-7042-4d93-8527-3be0d382498c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:08 devstack sudo[110810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c89026d0-7042-4d93-8527-3be0d382498c Jun 16 09:03:08 devstack sudo[110810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:08 devstack sudo[110810]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c89026d0-7042-4d93-8527-3be0d382498c" returned: 0 in 0.580s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:08 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-quobyte-c89026d0-7042-4d93-8527-3be0d382498c" released by "delete_volume" :: held 1.313s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:09 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Created reservations ['16b16ce2-f0f6-4c53-8cab-821400b713a5', '966f926d-7c17-43ef-af4f-2341e6ed2533', '3d5e7112-0736-4fc1-bab7-9de99ca49a49', 'a5789338-8cf1-466f-933b-66cc77b03a33'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:03:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:09 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:09 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:09 devstack sudo[110814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:09 devstack sudo[110814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:09 devstack sudo[110814]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.570s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:09 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:09 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Deleted volume successfully. Jun 16 09:03:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1f0ca273-bdf6-4533-b1e5-cd73739e1fb0 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-c89026d0-7042-4d93-8527-3be0d382498c-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "cinder-9c50b9c4-2b75-4787-a616-55fd9f5fd302-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-9c50b9c4-2b75-4787-a616-55fd9f5fd302-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "cinder-quobyte-9c50b9c4-2b75-4787-a616-55fd9f5fd302" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-quobyte-9c50b9c4-2b75-4787-a616-55fd9f5fd302" acquired by "delete_volume" :: waited 0.014s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:09 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efdb7f6-e029-44f4-9a67-bc012602a442]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9c50b9c4-2b75-4787-a616-55fd9f5fd302 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:09 devstack sudo[110817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9c50b9c4-2b75-4787-a616-55fd9f5fd302 Jun 16 09:03:09 devstack sudo[110817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:10 devstack sudo[110817]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9c50b9c4-2b75-4787-a616-55fd9f5fd302" returned: 0 in 0.673s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9c50b9c4-2b75-4787-a616-55fd9f5fd302 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:10 devstack sudo[110822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9c50b9c4-2b75-4787-a616-55fd9f5fd302 Jun 16 09:03:10 devstack sudo[110822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:11 devstack sudo[110822]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-9c50b9c4-2b75-4787-a616-55fd9f5fd302" returned: 0 in 0.582s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-quobyte-9c50b9c4-2b75-4787-a616-55fd9f5fd302" released by "delete_volume" :: held 1.295s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:11 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Created reservations ['f8ef7606-4a8d-40e5-a185-3fa479610338', '9086360a-b747-412a-a870-7700966b06d0', 'b8f8cb3f-400e-4a5f-9840-7a336a4c9e29', '1e4e962b-a547-4e96-94b5-ef0304cb312e'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:03:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:11 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:11 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:11 devstack sudo[110826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:11 devstack sudo[110826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:11 devstack sudo[110826]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.629s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:11 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:11 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Deleted volume successfully. Jun 16 09:03:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-1899d855-f19c-4e5d-a775-b470b7d8aa49 tempest-CreateVolumesFromSourceVolumeTest-836752199 None] Lock "cinder-9c50b9c4-2b75-4787-a616-55fd9f5fd302-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:21 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:UPDATE=72,cinder:SELECT=39,cinder:DELETE=7,cinder:INSERT=12 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 09:03:21 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=46,cinder:INSERT=18,cinder:UPDATE=61,cinder:DELETE=5 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Flow 'volume_create_manager' (ee2805ce-a9d4-4a50-8d6f-9fcc6b01f83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2237f392-32b5-413c-8de4-36ee65fc0c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2237f392-32b5-413c-8de4-36ee65fc0c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-330133999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3a40a5-95fc-44ca-9ffe-a6071d704fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70eb72fe70a24235a34425e9b26dce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:24Z,use_quota=True,user_id='6789b7deb03d41429d650e695ce65b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c8ba7a-c2f2-4a4c-991f-07c87ac27290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c8ba7a-c2f2-4a4c-991f-07c87ac27290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb928569-e6ca-4ca0-91b7-f5f49ae87089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb928569-e6ca-4ca0-91b7-f5f49ae87089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd3a40a5-95fc-44ca-9ffe-a6071d704fea', 'volume_name': 'volume-fd3a40a5-95fc-44ca-9ffe-a6071d704fea', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647da8e2-f4f0-4c61-bce3-32f1144c5c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647da8e2-f4f0-4c61-bce3-32f1144c5c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae56d0bf-a901-4dd6-a727-d5784740be0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:23 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume fd3a40a5-95fc-44ca-9ffe-a6071d704fea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd3a40a5-95fc-44ca-9ffe-a6071d704fea', 'volume_size': 1} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-330133999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3a40a5-95fc-44ca-9ffe-a6071d704fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70eb72fe70a24235a34425e9b26dce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:24Z,use_quota=True,user_id='6789b7deb03d41429d650e695ce65b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Creating volume fd3a40a5-95fc-44ca-9ffe-a6071d704fea {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:03:23 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fd3a40a5-95fc-44ca-9ffe-a6071d704fea 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:23 devstack sudo[110905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fd3a40a5-95fc-44ca-9ffe-a6071d704fea 1073741824 Jun 16 09:03:23 devstack sudo[110905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Flow 'volume_create_manager' (e47dc505-7e97-4aef-9ce8-dfa07715983f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ab67b7-454a-4a29-a98d-53bdeeb971e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ab67b7-454a-4a29-a98d-53bdeeb971e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-728614122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da28801-200b-429a-b1cc-bade52dfd26c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a85298575694d6e8d56281bbf5255f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:24Z,use_quota=True,user_id='fa81650c684a4f61a5ce4afae9d699ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e6425b-1395-430b-9f76-0b157855f25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e6425b-1395-430b-9f76-0b157855f25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ecce98-9f5a-4e2b-b71d-b5502b1d2f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ecce98-9f5a-4e2b-b71d-b5502b1d2f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1da28801-200b-429a-b1cc-bade52dfd26c', 'volume_name': 'volume-1da28801-200b-429a-b1cc-bade52dfd26c', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65eff1b-0e0b-446d-ad45-ae29c7e8dea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65eff1b-0e0b-446d-ad45-ae29c7e8dea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1df7ba-6640-4bda-bc5d-820de92a2918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:23 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Volume 1da28801-200b-429a-b1cc-bade52dfd26c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1da28801-200b-429a-b1cc-bade52dfd26c', 'volume_size': 1} Jun 16 09:03:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Flow 'volume_create_manager' (2d7d242c-a2ed-4ec0-ad89-584f1021f383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c281c2a1-b287-4f34-9b83-bd6687b07d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c281c2a1-b287-4f34-9b83-bd6687b07d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-526775711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30bd547-aa01-41bc-9107-919dd15a7ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a85298575694d6e8d56281bbf5255f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:24Z,use_quota=True,user_id='fa81650c684a4f61a5ce4afae9d699ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ed494d-ff63-4b25-9e96-bf20c4700438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ed494d-ff63-4b25-9e96-bf20c4700438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcfdef4-cc6a-409a-8b76-e84a7e85bbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcfdef4-cc6a-409a-8b76-e84a7e85bbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e30bd547-aa01-41bc-9107-919dd15a7ed8', 'volume_name': 'volume-e30bd547-aa01-41bc-9107-919dd15a7ed8', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b99826-0bae-4d84-ab6a-d97638df4dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b99826-0bae-4d84-ab6a-d97638df4dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e265ebf1-deaf-4f8b-a1ed-a2b736235150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:24 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Volume e30bd547-aa01-41bc-9107-919dd15a7ed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e30bd547-aa01-41bc-9107-919dd15a7ed8', 'volume_size': 1} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Flow 'volume_create_manager' (dded0f98-d90f-4a5b-b921-6de8ee877e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7606e6e-fc99-4608-8d38-4deb8a1b18b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7606e6e-fc99-4608-8d38-4deb8a1b18b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-205751704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9f0ed1-97e6-4ea4-a974-206b5f43bba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a85298575694d6e8d56281bbf5255f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:25Z,use_quota=True,user_id='fa81650c684a4f61a5ce4afae9d699ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55fe4b6-7b0c-4bdd-94a5-1f46b711cdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55fe4b6-7b0c-4bdd-94a5-1f46b711cdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cf3a85-0d49-4b9b-8a4d-d77cb1ac3aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cf3a85-0d49-4b9b-8a4d-d77cb1ac3aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b9f0ed1-97e6-4ea4-a974-206b5f43bba5', 'volume_name': 'volume-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde1968e-a49c-46ef-b9a2-84ff4c3c36c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:24 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde1968e-a49c-46ef-b9a2-84ff4c3c36c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46807a4-a974-41d3-8a76-9a83155e0900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:25 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Volume 6b9f0ed1-97e6-4ea4-a974-206b5f43bba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5', 'volume_size': 1} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:25 devstack sudo[110905]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fd3a40a5-95fc-44ca-9ffe-a6071d704fea 1073741824" returned: 0 in 1.386s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fd3a40a5-95fc-44ca-9ffe-a6071d704fea {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:25 devstack sudo[110911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fd3a40a5-95fc-44ca-9ffe-a6071d704fea Jun 16 09:03:25 devstack sudo[110911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Flow 'volume_create_manager' (24cdbfa5-9cb8-4c08-bc73-63fdfdd25cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ce2d31-8257-470b-9cd8-0822b194dd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ce2d31-8257-470b-9cd8-0822b194dd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233009598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c9e368-a3cf-4665-85fb-10469ded13f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a85298575694d6e8d56281bbf5255f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:25Z,use_quota=True,user_id='fa81650c684a4f61a5ce4afae9d699ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a40cd9c-3391-46de-8e81-c5e65f66082c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a40cd9c-3391-46de-8e81-c5e65f66082c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb7047f-6530-4b4c-8e61-7edfe9f3e9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb7047f-6530-4b4c-8e61-7edfe9f3e9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4c9e368-a3cf-4665-85fb-10469ded13f2', 'volume_name': 'volume-b4c9e368-a3cf-4665-85fb-10469ded13f2', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fea31a-7d13-4548-9304-7d09c1f6f6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fea31a-7d13-4548-9304-7d09c1f6f6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81dfc5c3-d405-4230-818d-b2535b73fe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:25 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Volume b4c9e368-a3cf-4665-85fb-10469ded13f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4c9e368-a3cf-4665-85fb-10469ded13f2', 'volume_size': 1} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Flow 'volume_create_manager' (f4f0caa0-9f34-44b2-989d-254bcec706c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047ce592-a84b-4e66-920c-85d9de7742f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047ce592-a84b-4e66-920c-85d9de7742f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1092913113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d227c19c-ffd6-4ecf-bbc5-f13d1afc3199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a85298575694d6e8d56281bbf5255f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:26Z,use_quota=True,user_id='fa81650c684a4f61a5ce4afae9d699ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:25 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09947b82-f795-44fd-8fb0-8a39c52041de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09947b82-f795-44fd-8fb0-8a39c52041de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2998f0ff-8358-49e8-bb6f-2f12eb3af468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2998f0ff-8358-49e8-bb6f-2f12eb3af468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd227c19c-ffd6-4ecf-bbc5-f13d1afc3199', 'volume_name': 'volume-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477c77f0-fc20-40a1-bbe7-00c74ae09c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:26 devstack sudo[110911]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477c77f0-fc20-40a1-bbe7-00c74ae09c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f949fd0f-65bf-4c7e-92eb-b9ccbba22b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:26 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Volume d227c19c-ffd6-4ecf-bbc5-f13d1afc3199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199', 'volume_size': 1} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fd3a40a5-95fc-44ca-9ffe-a6071d704fea" returned: 0 in 0.902s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] <== create_volume: return (2338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.340s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.046s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-728614122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da28801-200b-429a-b1cc-bade52dfd26c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a85298575694d6e8d56281bbf5255f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:24Z,use_quota=True,user_id='fa81650c684a4f61a5ce4afae9d699ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Creating volume 1da28801-200b-429a-b1cc-bade52dfd26c {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:03:26 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1da28801-200b-429a-b1cc-bade52dfd26c 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae56d0bf-a901-4dd6-a727-d5784740be0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd3a40a5-95fc-44ca-9ffe-a6071d704fea', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:26 devstack sudo[110914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1da28801-200b-429a-b1cc-bade52dfd26c 1073741824 Jun 16 09:03:26 devstack sudo[110914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e20ffe-d659-45fa-ba4b-13077a603be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:26 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume volume-fd3a40a5-95fc-44ca-9ffe-a6071d704fea (fd3a40a5-95fc-44ca-9ffe-a6071d704fea): created successfully Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e20ffe-d659-45fa-ba4b-13077a603be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:26 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Flow 'volume_create_manager' (ee2805ce-a9d4-4a50-8d6f-9fcc6b01f83f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:26 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-e8765d6f-b7ff-4773-a853-c94be3c8ea84 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Created volume successfully. Jun 16 09:03:27 devstack sudo[110914]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1da28801-200b-429a-b1cc-bade52dfd26c 1073741824" returned: 0 in 0.994s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1da28801-200b-429a-b1cc-bade52dfd26c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:27 devstack sudo[110920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1da28801-200b-429a-b1cc-bade52dfd26c Jun 16 09:03:27 devstack sudo[110920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Flow 'volume_create_manager' (fadbd3aa-ecdd-4c2c-87c4-3534b598f4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0483dd52-5531-4c53-bc96-3622eea94f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0483dd52-5531-4c53-bc96-3622eea94f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-503822287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba237aa-2f83-4927-904a-f5d61de62461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70eb72fe70a24235a34425e9b26dce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:28Z,use_quota=True,user_id='6789b7deb03d41429d650e695ce65b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc635cf-fe33-46ca-ba31-96e002ee69db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc635cf-fe33-46ca-ba31-96e002ee69db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f52082-1b9f-4df9-b0c2-221fda8ebe1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f52082-1b9f-4df9-b0c2-221fda8ebe1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ba237aa-2f83-4927-904a-f5d61de62461', 'volume_name': 'volume-0ba237aa-2f83-4927-904a-f5d61de62461', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98551045-957a-460b-be7b-8ff2101da20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98551045-957a-460b-be7b-8ff2101da20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ccada7-90f8-4484-9777-a062004618c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:27 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume 0ba237aa-2f83-4927-904a-f5d61de62461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ba237aa-2f83-4927-904a-f5d61de62461', 'volume_size': 1} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:27 devstack sudo[110920]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1da28801-200b-429a-b1cc-bade52dfd26c" returned: 0 in 0.856s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.366s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-526775711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30bd547-aa01-41bc-9107-919dd15a7ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a85298575694d6e8d56281bbf5255f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:24Z,use_quota=True,user_id='fa81650c684a4f61a5ce4afae9d699ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Creating volume e30bd547-aa01-41bc-9107-919dd15a7ed8 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:03:27 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:03:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e30bd547-aa01-41bc-9107-919dd15a7ed8 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1df7ba-6640-4bda-bc5d-820de92a2918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1da28801-200b-429a-b1cc-bade52dfd26c', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:28 devstack sudo[110923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e30bd547-aa01-41bc-9107-919dd15a7ed8 1073741824 Jun 16 09:03:28 devstack sudo[110923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c45f5d-634a-4090-bbf6-09c6ae10e707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:28 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Volume volume-1da28801-200b-429a-b1cc-bade52dfd26c (1da28801-200b-429a-b1cc-bade52dfd26c): created successfully Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c45f5d-634a-4090-bbf6-09c6ae10e707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Flow 'volume_create_manager' (e47dc505-7e97-4aef-9ce8-dfa07715983f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:28 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-a0d8f066-9dcc-4172-b598-f79f8e3af247 tempest-CreateVolumesFromImageTest-1451662576 None] Created volume successfully. Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Flow 'volume_create_manager' (1e91aaaa-cea5-469d-b709-5ead27cf7c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60bdc01c-6e27-4fda-a323-cc2d6e6feed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60bdc01c-6e27-4fda-a323-cc2d6e6feed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-177320242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2004fbf2-7c23-4916-a161-3dd1333b2d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70eb72fe70a24235a34425e9b26dce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:28Z,use_quota=True,user_id='6789b7deb03d41429d650e695ce65b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d261cf48-a79e-4835-aa95-0f265a6d5809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d261cf48-a79e-4835-aa95-0f265a6d5809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f27be63-39bf-462d-952b-8a1fa7aee19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f27be63-39bf-462d-952b-8a1fa7aee19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2004fbf2-7c23-4916-a161-3dd1333b2d7f', 'volume_name': 'volume-2004fbf2-7c23-4916-a161-3dd1333b2d7f', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931e43c5-6f08-4298-9688-eb1c3ec46e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931e43c5-6f08-4298-9688-eb1c3ec46e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef6006a-2879-4201-b643-908b583bab46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:28 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume 2004fbf2-7c23-4916-a161-3dd1333b2d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2004fbf2-7c23-4916-a161-3dd1333b2d7f', 'volume_size': 1} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Flow 'volume_create_manager' (6359e4d2-dac4-424f-9c62-4fb952f2b77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece8071f-2445-4c77-b2fb-8f1d7e0958eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Flow 'volume_create_manager' (910f046b-915f-4d58-be73-c906e06b4b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb7def3-53e1-4ede-8fad-a3608275a911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb7def3-53e1-4ede-8fad-a3608275a911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='084954b6cbf143c09f0638da7663d0d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:29Z,use_quota=True,user_id='194a82b45b8243c4a56ff5bfb457cdbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bfccb3e-4c9c-486c-a93b-e7bddf353c1f),volume_type_id=6bfccb3e-4c9c-486c-a93b-e7bddf353c1f)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb434f9-8eea-42f1-900d-94db44ee067c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb434f9-8eea-42f1-900d-94db44ee067c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40db5676-2f20-486e-8c6b-9cf6bd4b3e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.image.glance [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Creating Keystone auth plugin from conf {{(pid=92348) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece8071f-2445-4c77-b2fb-8f1d7e0958eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-95485270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf405fc-e8be-4509-8df7-9da73d2cb8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70eb72fe70a24235a34425e9b26dce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:29Z,use_quota=True,user_id='6789b7deb03d41429d650e695ce65b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f37514-ae27-4773-a473-e4a154b5ae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f37514-ae27-4773-a473-e4a154b5ae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a72abc-2f73-452b-92d7-f926352711ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a72abc-2f73-452b-92d7-f926352711ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcf405fc-e8be-4509-8df7-9da73d2cb8ae', 'volume_name': 'volume-fcf405fc-e8be-4509-8df7-9da73d2cb8ae', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86206dd-99d6-4ad9-889d-55e1fa246a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86206dd-99d6-4ad9-889d-55e1fa246a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7fea78d-ca9b-44c0-bd8f-a068af5c62ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:29 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume fcf405fc-e8be-4509-8df7-9da73d2cb8ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcf405fc-e8be-4509-8df7-9da73d2cb8ae', 'volume_size': 1} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:29 devstack sudo[110923]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e30bd547-aa01-41bc-9107-919dd15a7ed8 1073741824" returned: 0 in 1.188s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e30bd547-aa01-41bc-9107-919dd15a7ed8 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:29 devstack sudo[110931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e30bd547-aa01-41bc-9107-919dd15a7ed8 Jun 16 09:03:29 devstack sudo[110931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Flow 'volume_create_manager' (a21a6a27-7ec1-4c6e-957f-f7e4606f0c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c239663a-5334-47c4-8596-ef63c9f891d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c239663a-5334-47c4-8596-ef63c9f891d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1202849735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=661b58ff-e8ac-4ece-b2e3-015f07f11e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70eb72fe70a24235a34425e9b26dce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:29Z,use_quota=True,user_id='6789b7deb03d41429d650e695ce65b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd645ddf-232f-490c-99ff-e99dc4e4876d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd645ddf-232f-490c-99ff-e99dc4e4876d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727934ea-2929-46d8-8f5d-0b4991ddfb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727934ea-2929-46d8-8f5d-0b4991ddfb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '661b58ff-e8ac-4ece-b2e3-015f07f11e57', 'volume_name': 'volume-661b58ff-e8ac-4ece-b2e3-015f07f11e57', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f73588-5fce-4d3c-87bf-d33190e42d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f73588-5fce-4d3c-87bf-d33190e42d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3601bcd6-b001-445c-a8ac-0e0272b4992c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:29 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume 661b58ff-e8ac-4ece-b2e3-015f07f11e57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-661b58ff-e8ac-4ece-b2e3-015f07f11e57', 'volume_size': 1} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40db5676-2f20-486e-8c6b-9cf6bd4b3e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e', 'volume_name': 'volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e', 'volume_size': 1, 'image_id': '8d4613ab-7078-46b7-bb97-d260ff2ffa85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d4613ab-7078-46b7-bb97-d260ff2ffa85', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'baa1f361259eb77a671f19c08036ecf5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '084954b6cbf143c09f0638da7663d0d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3d01a5efd4c69283e13ae93ed80414d5c07025a7d71124ab29944e29698e9322da8898002abc0d5e4578c2fd6ab9b0777159992ac893e9d07a199647911daec', 'id': '8d4613ab-7078-46b7-bb97-d260ff2ffa85', 'created_at': datetime.datetime(2026, 6, 16, 7, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 7, 3, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d4613ab-7078-46b7-bb97-d260ff2ffa85/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe10c925-cea2-4cdb-8be7-2ea46e0d735f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe10c925-cea2-4cdb-8be7-2ea46e0d735f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb04160-1854-4b1b-83a4-d05642a8098b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:29 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Volume 1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e', 'volume_size': 1, 'image_id': '8d4613ab-7078-46b7-bb97-d260ff2ffa85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d4613ab-7078-46b7-bb97-d260ff2ffa85', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'baa1f361259eb77a671f19c08036ecf5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '084954b6cbf143c09f0638da7663d0d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3d01a5efd4c69283e13ae93ed80414d5c07025a7d71124ab29944e29698e9322da8898002abc0d5e4578c2fd6ab9b0777159992ac893e9d07a199647911daec', 'id': '8d4613ab-7078-46b7-bb97-d260ff2ffa85', 'created_at': datetime.datetime(2026, 6, 16, 7, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 7, 3, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d4613ab-7078-46b7-bb97-d260ff2ffa85/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Trying to clone 1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e from image 8d4613ab-7078-46b7-bb97-d260ff2ffa85 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d4613ab-7078-46b7-bb97-d260ff2ffa85', 'metadata': {}}]). {{(pid=92348) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 16 09:03:29 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Image download 0.00 MB at 0.00 MB/s Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Flow 'volume_create_manager' (17c6396e-1ad2-4f4e-8019-4887d5611a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feea743f-963c-432a-9ae7-e55148b165dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feea743f-963c-432a-9ae7-e55148b165dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-643519797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e353ee-9868-4ef4-b7fe-eaee40d10055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70eb72fe70a24235a34425e9b26dce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:30Z,use_quota=True,user_id='6789b7deb03d41429d650e695ce65b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83f690d-eef0-4268-a7e1-573bace6bd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83f690d-eef0-4268-a7e1-573bace6bd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1e6166-542d-4879-a3dd-af59d8ffd599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1e6166-542d-4879-a3dd-af59d8ffd599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e353ee-9868-4ef4-b7fe-eaee40d10055', 'volume_name': 'volume-a0e353ee-9868-4ef4-b7fe-eaee40d10055', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8cb04e-e0ad-4257-b2cb-6a4ef1cd5cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8cb04e-e0ad-4257-b2cb-6a4ef1cd5cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f990b6-7072-4f87-9d11-bef6e239fecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:29 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume a0e353ee-9868-4ef4-b7fe-eaee40d10055: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e353ee-9868-4ef4-b7fe-eaee40d10055', 'volume_size': 1} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6050704-e310-403c-8bf1-3b236d819d88]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:30 devstack sudo[110935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD Jun 16 09:03:30 devstack sudo[110935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:30 devstack sudo[110931]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e30bd547-aa01-41bc-9107-919dd15a7ed8" returned: 0 in 0.773s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.026s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-205751704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9f0ed1-97e6-4ea4-a974-206b5f43bba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a85298575694d6e8d56281bbf5255f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:25Z,use_quota=True,user_id='fa81650c684a4f61a5ce4afae9d699ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Creating volume 6b9f0ed1-97e6-4ea4-a974-206b5f43bba5 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:03:30 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e265ebf1-deaf-4f8b-a1ed-a2b736235150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30bd547-aa01-41bc-9107-919dd15a7ed8', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcca1026-88d0-4dcd-a900-05fbe20cf3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:30 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Volume volume-e30bd547-aa01-41bc-9107-919dd15a7ed8 (e30bd547-aa01-41bc-9107-919dd15a7ed8): created successfully Jun 16 09:03:30 devstack sudo[110937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5 1073741824 Jun 16 09:03:30 devstack sudo[110937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcca1026-88d0-4dcd-a900-05fbe20cf3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Flow 'volume_create_manager' (2d7d242c-a2ed-4ec0-ad89-584f1021f383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:30 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-a013e351-5f84-4d34-933c-f8cc5775c65b tempest-CreateVolumesFromImageTest-1451662576 None] Created volume successfully. Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:30 devstack sudo[110939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:30 devstack sudo[110939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:30 devstack sudo[110935]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD" returned: 0 in 1.004s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:31 devstack sudo[110943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD Jun 16 09:03:31 devstack sudo[110943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:31 devstack sudo[110939]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.879s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:31 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:31 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 09:03:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 09:03:31 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 09:03:31 devstack sudo[110937]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5 1073741824" returned: 0 in 1.294s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:31 devstack sudo[110950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5 Jun 16 09:03:31 devstack sudo[110950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:31 devstack sudo[110943]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD" returned: 1 in 0.813s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 09:03:31 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Temporary image 8d4613ab-7078-46b7-bb97-d260ff2ffa85 is fetched for user 194a82b45b8243c4a56ff5bfb457cdbb. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 16 09:03:31 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[064e8143-a470-49e8-bf6e-fd39fef37936]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:31 devstack sudo[110955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD Jun 16 09:03:31 devstack sudo[110955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:32 devstack sudo[110950]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5" returned: 0 in 0.703s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] <== create_volume: return (2069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.545s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233009598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c9e368-a3cf-4665-85fb-10469ded13f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a85298575694d6e8d56281bbf5255f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:25Z,use_quota=True,user_id='fa81650c684a4f61a5ce4afae9d699ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Creating volume b4c9e368-a3cf-4665-85fb-10469ded13f2 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:03:32 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b4c9e368-a3cf-4665-85fb-10469ded13f2 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:32 devstack sudo[110960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b4c9e368-a3cf-4665-85fb-10469ded13f2 1073741824 Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46807a4-a974-41d3-8a76-9a83155e0900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:32 devstack sudo[110960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae7904c-aa08-4fb8-9258-342bdceb4c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:32 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Volume volume-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5 (6b9f0ed1-97e6-4ea4-a974-206b5f43bba5): created successfully Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae7904c-aa08-4fb8-9258-342bdceb4c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Flow 'volume_create_manager' (dded0f98-d90f-4a5b-b921-6de8ee877e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:32 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c870bfe2-088e-4f08-912e-95af48e72fbb tempest-CreateVolumesFromImageTest-1451662576 None] Created volume successfully. Jun 16 09:03:32 devstack sudo[110955]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD" returned: 0 in 0.744s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:32 devstack sudo[110964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD Jun 16 09:03:32 devstack sudo[110964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:33 devstack sudo[110960]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b4c9e368-a3cf-4665-85fb-10469ded13f2 1073741824" returned: 0 in 1.007s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b4c9e368-a3cf-4665-85fb-10469ded13f2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:33 devstack sudo[110970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b4c9e368-a3cf-4665-85fb-10469ded13f2 Jun 16 09:03:33 devstack sudo[110970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:33 devstack sudo[110964]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD" returned: 1 in 0.861s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:33 devstack sudo[110970]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b4c9e368-a3cf-4665-85fb-10469ded13f2" returned: 0 in 0.631s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.785s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1092913113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d227c19c-ffd6-4ecf-bbc5-f13d1afc3199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a85298575694d6e8d56281bbf5255f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:26Z,use_quota=True,user_id='fa81650c684a4f61a5ce4afae9d699ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Creating volume d227c19c-ffd6-4ecf-bbc5-f13d1afc3199 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:03:33 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:33 devstack sudo[110976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199 1073741824 Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81dfc5c3-d405-4230-818d-b2535b73fe06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4c9e368-a3cf-4665-85fb-10469ded13f2', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:33 devstack sudo[110976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b628483c-28fb-4521-b8f7-b9d7c2da4c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:33 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Volume volume-b4c9e368-a3cf-4665-85fb-10469ded13f2 (b4c9e368-a3cf-4665-85fb-10469ded13f2): created successfully Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b628483c-28fb-4521-b8f7-b9d7c2da4c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Flow 'volume_create_manager' (24cdbfa5-9cb8-4c08-bc73-63fdfdd25cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:33 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-2d30b236-3f4b-443d-bc5a-d5d6fd8cee08 tempest-CreateVolumesFromImageTest-1451662576 None] Created volume successfully. Jun 16 09:03:34 devstack sudo[110976]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199 1073741824" returned: 0 in 0.918s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:34 devstack sudo[110982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199 Jun 16 09:03:34 devstack sudo[110982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:35 devstack sudo[110982]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199" returned: 0 in 0.720s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:03:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.659s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-503822287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba237aa-2f83-4927-904a-f5d61de62461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70eb72fe70a24235a34425e9b26dce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:28Z,use_quota=True,user_id='6789b7deb03d41429d650e695ce65b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:03:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Creating volume 0ba237aa-2f83-4927-904a-f5d61de62461 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:03:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:03:35 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:03:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0ba237aa-2f83-4927-904a-f5d61de62461 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:35 devstack sudo[110985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0ba237aa-2f83-4927-904a-f5d61de62461 1073741824 Jun 16 09:03:35 devstack sudo[110985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f949fd0f-65bf-4c7e-92eb-b9ccbba22b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ec4a74-b871-4a11-a469-32134f3ef91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:35 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Volume volume-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199 (d227c19c-ffd6-4ecf-bbc5-f13d1afc3199): created successfully Jun 16 09:03:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ec4a74-b871-4a11-a469-32134f3ef91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Flow 'volume_create_manager' (f4f0caa0-9f34-44b2-989d-254bcec706c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:35 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ff9200d3-4b90-44ef-abe6-d19fc984e1f3 tempest-CreateVolumesFromImageTest-1451662576 None] Created volume successfully. Jun 16 09:03:36 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "cinder-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:36 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:36 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "cinder-quobyte-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:36 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-quobyte-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199" acquired by "delete_volume" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:36 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8c795e-d9d6-4b09-ad76-6eb7a3f39ba6]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:36 devstack sudo[110985]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0ba237aa-2f83-4927-904a-f5d61de62461 1073741824" returned: 0 in 0.913s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0ba237aa-2f83-4927-904a-f5d61de62461 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:36 devstack sudo[110992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0ba237aa-2f83-4927-904a-f5d61de62461 Jun 16 09:03:36 devstack sudo[110992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:36 devstack sudo[110991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199 Jun 16 09:03:36 devstack sudo[110991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:37 devstack sudo[110992]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0ba237aa-2f83-4927-904a-f5d61de62461" returned: 0 in 0.617s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.668s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-177320242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2004fbf2-7c23-4916-a161-3dd1333b2d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70eb72fe70a24235a34425e9b26dce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:28Z,use_quota=True,user_id='6789b7deb03d41429d650e695ce65b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Creating volume 2004fbf2-7c23-4916-a161-3dd1333b2d7f {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:03:37 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2004fbf2-7c23-4916-a161-3dd1333b2d7f 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:37 devstack sudo[110991]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:37 devstack sudo[110999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2004fbf2-7c23-4916-a161-3dd1333b2d7f 1073741824 Jun 16 09:03:37 devstack sudo[110999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ccada7-90f8-4484-9777-a062004618c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ba237aa-2f83-4927-904a-f5d61de62461', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b62882c4-6884-4e66-ba8d-c3c43a61046f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199" returned: 0 in 0.762s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:37 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume volume-0ba237aa-2f83-4927-904a-f5d61de62461 (0ba237aa-2f83-4927-904a-f5d61de62461): created successfully Jun 16 09:03:37 devstack sudo[111001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199 Jun 16 09:03:37 devstack sudo[111001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b62882c4-6884-4e66-ba8d-c3c43a61046f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Flow 'volume_create_manager' (fadbd3aa-ecdd-4c2c-87c4-3534b598f4b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:37 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-2da5766e-f016-4485-8e40-6a50b0625be8 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Created volume successfully. Jun 16 09:03:37 devstack sudo[111001]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199" returned: 0 in 0.734s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-quobyte-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199" released by "delete_volume" :: held 1.542s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] Created reservations ['17612f5f-128a-486f-9b24-ba34fcf4e8ce', '092b60ea-aabb-406e-899a-8d765c6f2ff6', '562eda3b-9676-4a54-a5c7-ffc124970835', '3dffcc81-c29f-497a-b471-fbba493bc6d2'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:03:37 devstack sudo[110999]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2004fbf2-7c23-4916-a161-3dd1333b2d7f 1073741824" returned: 0 in 0.886s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2004fbf2-7c23-4916-a161-3dd1333b2d7f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:38 devstack sudo[111007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2004fbf2-7c23-4916-a161-3dd1333b2d7f Jun 16 09:03:38 devstack sudo[111007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:38 devstack sudo[111009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:38 devstack sudo[111009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "cinder-b4c9e368-a3cf-4665-85fb-10469ded13f2-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-b4c9e368-a3cf-4665-85fb-10469ded13f2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "cinder-quobyte-b4c9e368-a3cf-4665-85fb-10469ded13f2" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-quobyte-b4c9e368-a3cf-4665-85fb-10469ded13f2" acquired by "delete_volume" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde19071-5434-498a-b304-778ffb571bd5]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b4c9e368-a3cf-4665-85fb-10469ded13f2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:38 devstack sudo[111007]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2004fbf2-7c23-4916-a161-3dd1333b2d7f" returned: 0 in 0.737s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.765s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-95485270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf405fc-e8be-4509-8df7-9da73d2cb8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70eb72fe70a24235a34425e9b26dce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:29Z,use_quota=True,user_id='6789b7deb03d41429d650e695ce65b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Creating volume fcf405fc-e8be-4509-8df7-9da73d2cb8ae {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:03:38 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fcf405fc-e8be-4509-8df7-9da73d2cb8ae 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef6006a-2879-4201-b643-908b583bab46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2004fbf2-7c23-4916-a161-3dd1333b2d7f', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:38 devstack sudo[111009]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:38 devstack sudo[111015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fcf405fc-e8be-4509-8df7-9da73d2cb8ae 1073741824 Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094eb925-41a7-41a7-9873-dc9173631c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:38 devstack sudo[111015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.757s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:38 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume volume-2004fbf2-7c23-4916-a161-3dd1333b2d7f (2004fbf2-7c23-4916-a161-3dd1333b2d7f): created successfully Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094eb925-41a7-41a7-9873-dc9173631c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Flow 'volume_create_manager' (1e91aaaa-cea5-469d-b709-5ead27cf7c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:38 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] Deleted volume successfully. Jun 16 09:03:38 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-2cc4a7b6-d91d-42cb-b078-801b4c230e7a tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Created volume successfully. Jun 16 09:03:38 devstack sudo[111014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b4c9e368-a3cf-4665-85fb-10469ded13f2 Jun 16 09:03:38 devstack sudo[111014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-0511ab07-0af1-41f4-a20e-1d3c05e34e06 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-d227c19c-ffd6-4ecf-bbc5-f13d1afc3199-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:39 devstack sudo[111014]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b4c9e368-a3cf-4665-85fb-10469ded13f2" returned: 0 in 0.792s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b4c9e368-a3cf-4665-85fb-10469ded13f2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:39 devstack sudo[111024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b4c9e368-a3cf-4665-85fb-10469ded13f2 Jun 16 09:03:39 devstack sudo[111024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:39 devstack sudo[111015]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fcf405fc-e8be-4509-8df7-9da73d2cb8ae 1073741824" returned: 0 in 0.920s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fcf405fc-e8be-4509-8df7-9da73d2cb8ae {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:39 devstack sudo[111026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fcf405fc-e8be-4509-8df7-9da73d2cb8ae Jun 16 09:03:39 devstack sudo[111026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:40 devstack sudo[111024]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-b4c9e368-a3cf-4665-85fb-10469ded13f2" returned: 0 in 0.650s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-quobyte-b4c9e368-a3cf-4665-85fb-10469ded13f2" released by "delete_volume" :: held 1.492s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] Created reservations ['ada602de-135e-4926-8498-0bb6bf6aaf50', '0ae5c908-92e1-4f6e-a34b-b310f9b24d91', 'bd588cd6-e5c8-4b31-afc0-99144972c6dd', '4de443fb-08d8-4d2b-8eb2-ba0cac0e74af'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:40 devstack sudo[111026]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fcf405fc-e8be-4509-8df7-9da73d2cb8ae" returned: 0 in 0.614s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.882s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1202849735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=661b58ff-e8ac-4ece-b2e3-015f07f11e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70eb72fe70a24235a34425e9b26dce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:29Z,use_quota=True,user_id='6789b7deb03d41429d650e695ce65b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:03:40 devstack sudo[111030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:40 devstack sudo[111030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Creating volume 661b58ff-e8ac-4ece-b2e3-015f07f11e57 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:03:40 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-661b58ff-e8ac-4ece-b2e3-015f07f11e57 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7fea78d-ca9b-44c0-bd8f-a068af5c62ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf405fc-e8be-4509-8df7-9da73d2cb8ae', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e577799-32ad-4208-b328-aa9bf3874438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:40 devstack sudo[111032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-661b58ff-e8ac-4ece-b2e3-015f07f11e57 1073741824 Jun 16 09:03:40 devstack sudo[111032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:40 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume volume-fcf405fc-e8be-4509-8df7-9da73d2cb8ae (fcf405fc-e8be-4509-8df7-9da73d2cb8ae): created successfully Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e577799-32ad-4208-b328-aa9bf3874438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Flow 'volume_create_manager' (6359e4d2-dac4-424f-9c62-4fb952f2b77f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:40 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-af32b8dc-cb11-4feb-b8ba-2d85495865cb tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Created volume successfully. Jun 16 09:03:40 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "cinder-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "cinder-quobyte-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-quobyte-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:41 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8666a85-0c9f-4c8e-9de6-8524ae69a91b]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:41 devstack sudo[111030]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.794s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:41 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:41 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] Deleted volume successfully. Jun 16 09:03:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-a0d07d81-c6d8-4913-9694-20c8d57936cd tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-b4c9e368-a3cf-4665-85fb-10469ded13f2-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:41 devstack sudo[111038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5 Jun 16 09:03:41 devstack sudo[111038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:41 devstack sudo[111032]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-661b58ff-e8ac-4ece-b2e3-015f07f11e57 1073741824" returned: 0 in 1.051s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-661b58ff-e8ac-4ece-b2e3-015f07f11e57 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:41 devstack sudo[111041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-661b58ff-e8ac-4ece-b2e3-015f07f11e57 Jun 16 09:03:41 devstack sudo[111041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:42 devstack sudo[111038]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5" returned: 0 in 0.898s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:42 devstack sudo[111048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5 Jun 16 09:03:42 devstack sudo[111048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:42 devstack sudo[111041]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-661b58ff-e8ac-4ece-b2e3-015f07f11e57" returned: 0 in 0.634s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.232s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-643519797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e353ee-9868-4ef4-b7fe-eaee40d10055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70eb72fe70a24235a34425e9b26dce87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:30Z,use_quota=True,user_id='6789b7deb03d41429d650e695ce65b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Creating volume a0e353ee-9868-4ef4-b7fe-eaee40d10055 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:03:42 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a0e353ee-9868-4ef4-b7fe-eaee40d10055 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:42 devstack sudo[111050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a0e353ee-9868-4ef4-b7fe-eaee40d10055 1073741824 Jun 16 09:03:42 devstack sudo[111050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3601bcd6-b001-445c-a8ac-0e0272b4992c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-661b58ff-e8ac-4ece-b2e3-015f07f11e57', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26dd54e3-19b9-417f-ab11-00d900ac2426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:42 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume volume-661b58ff-e8ac-4ece-b2e3-015f07f11e57 (661b58ff-e8ac-4ece-b2e3-015f07f11e57): created successfully Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26dd54e3-19b9-417f-ab11-00d900ac2426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Flow 'volume_create_manager' (a21a6a27-7ec1-4c6e-957f-f7e4606f0c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:42 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-26fd5ba7-4d34-44d4-8a24-56d83503ca86 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Created volume successfully. Jun 16 09:03:42 devstack sudo[111048]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5" returned: 0 in 0.776s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-quobyte-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5" released by "delete_volume" :: held 1.732s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:42 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] Created reservations ['ebecbf90-96fb-4ffa-9bcc-fef61ceca1ce', '8c4991da-0568-4cf8-b554-f9b114076a5d', '6cd9c6bd-5699-4d48-9b3e-a89989c9cc6a', '5e732380-e73c-4944-8d01-83840b2361c5'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:03:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:43 devstack sudo[111056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:43 devstack sudo[111056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "cinder-e30bd547-aa01-41bc-9107-919dd15a7ed8-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-e30bd547-aa01-41bc-9107-919dd15a7ed8-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "cinder-quobyte-e30bd547-aa01-41bc-9107-919dd15a7ed8" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:43 devstack sudo[111050]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-quobyte-e30bd547-aa01-41bc-9107-919dd15a7ed8" acquired by "delete_volume" :: waited 0.023s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a0e353ee-9868-4ef4-b7fe-eaee40d10055 1073741824" returned: 0 in 1.346s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:43 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b70e23-5c90-4409-8715-035445fe70a7]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e30bd547-aa01-41bc-9107-919dd15a7ed8 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a0e353ee-9868-4ef4-b7fe-eaee40d10055 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:43 devstack sudo[111060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a0e353ee-9868-4ef4-b7fe-eaee40d10055 Jun 16 09:03:43 devstack sudo[111060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:43 devstack sudo[111059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e30bd547-aa01-41bc-9107-919dd15a7ed8 Jun 16 09:03:43 devstack sudo[111059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:44 devstack sudo[111056]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.017s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:44 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] Deleted volume successfully. Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bd5bcc02-4a33-4186-90b1-4624eee07a7b tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-6b9f0ed1-97e6-4ea4-a974-206b5f43bba5-delete_volume" released by "delete_volume" :: held 3.103s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:44 devstack sudo[111060]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a0e353ee-9868-4ef4-b7fe-eaee40d10055" returned: 0 in 0.755s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] <== create_volume: return (2177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.186s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.911s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='084954b6cbf143c09f0638da7663d0d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:29Z,use_quota=True,user_id='194a82b45b8243c4a56ff5bfb457cdbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bfccb3e-4c9c-486c-a93b-e7bddf353c1f),volume_type_id=6bfccb3e-4c9c-486c-a93b-e7bddf353c1f)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Creating volume 1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:03:44 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f990b6-7072-4f87-9d11-bef6e239fecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e353ee-9868-4ef4-b7fe-eaee40d10055', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77be140d-b08f-4160-ab3d-fc7c1ab45626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:44 devstack sudo[111065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e 1073741824 Jun 16 09:03:44 devstack sudo[111065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:44 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Volume volume-a0e353ee-9868-4ef4-b7fe-eaee40d10055 (a0e353ee-9868-4ef4-b7fe-eaee40d10055): created successfully Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77be140d-b08f-4160-ab3d-fc7c1ab45626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Flow 'volume_create_manager' (17c6396e-1ad2-4f4e-8019-4887d5611a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:44 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-0a603e31-1e53-4a72-a69f-41b37aa3e576 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Created volume successfully. Jun 16 09:03:44 devstack sudo[111059]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e30bd547-aa01-41bc-9107-919dd15a7ed8" returned: 0 in 1.187s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e30bd547-aa01-41bc-9107-919dd15a7ed8 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:44 devstack sudo[111070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e30bd547-aa01-41bc-9107-919dd15a7ed8 Jun 16 09:03:44 devstack sudo[111070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:45 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "cinder-a0e353ee-9868-4ef4-b7fe-eaee40d10055-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:45 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-a0e353ee-9868-4ef4-b7fe-eaee40d10055-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:45 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "cinder-quobyte-a0e353ee-9868-4ef4-b7fe-eaee40d10055" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:45 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-quobyte-a0e353ee-9868-4ef4-b7fe-eaee40d10055" acquired by "delete_volume" :: waited 0.014s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:45 devstack sudo[111070]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e30bd547-aa01-41bc-9107-919dd15a7ed8" returned: 0 in 0.859s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:45 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a850e3bc-7de9-465d-a635-59f96bc4ada5]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a0e353ee-9868-4ef4-b7fe-eaee40d10055 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:45 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-quobyte-e30bd547-aa01-41bc-9107-919dd15a7ed8" released by "delete_volume" :: held 2.131s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:45 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] Created reservations ['930521e9-9444-454b-b0be-260232417105', 'f59d4002-4cd0-4d7d-8a21-12cc9c252891', 'ada0dce6-9ead-4c49-b64c-5401203471c9', 'f18873f3-a611-4d14-9b27-302de7946aa0'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:03:45 devstack sudo[111077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a0e353ee-9868-4ef4-b7fe-eaee40d10055 Jun 16 09:03:45 devstack sudo[111077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:45 devstack sudo[111065]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:45 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:45 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e 1073741824" returned: 0 in 1.533s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:45 devstack sudo[111079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:45 devstack sudo[111079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:45 devstack sudo[111081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e Jun 16 09:03:45 devstack sudo[111081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "cinder-1da28801-200b-429a-b1cc-bade52dfd26c-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-1da28801-200b-429a-b1cc-bade52dfd26c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "cinder-quobyte-1da28801-200b-429a-b1cc-bade52dfd26c" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-quobyte-1da28801-200b-429a-b1cc-bade52dfd26c" acquired by "delete_volume" :: waited 0.033s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:46 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f712217a-ddab-47af-a5eb-e242020b3acc]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1da28801-200b-429a-b1cc-bade52dfd26c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:46 devstack sudo[111083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1da28801-200b-429a-b1cc-bade52dfd26c Jun 16 09:03:46 devstack sudo[111083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:46 devstack sudo[111079]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.762s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:46 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:46 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] Deleted volume successfully. Jun 16 09:03:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-02cb6cc6-ec33-4260-b38a-a85759ab9446 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-e30bd547-aa01-41bc-9107-919dd15a7ed8-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:46 devstack sudo[111081]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e" returned: 0 in 0.849s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:46 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] <== create_volume: return (2439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:03:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.443s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:46 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Attempting download of 8d4613ab-7078-46b7-bb97-d260ff2ffa85 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d4613ab-7078-46b7-bb97-d260ff2ffa85', 'metadata': {}}])) to volume 1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 16 09:03:46 devstack sudo[111077]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a0e353ee-9868-4ef4-b7fe-eaee40d10055" returned: 0 in 1.274s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a0e353ee-9868-4ef4-b7fe-eaee40d10055 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:46 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c151cc57-920d-463b-be5f-c2c93ab14acb]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d4613ab-7078-46b7-bb97-d260ff2ffa85_ofj88hvn {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:46 devstack sudo[111090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a0e353ee-9868-4ef4-b7fe-eaee40d10055 Jun 16 09:03:46 devstack sudo[111090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Flow 'volume_create_manager' (601dd390-b933-4cfb-acd2-5aa539e940b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c7fe0f-7544-49e4-af11-1cc415d05d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:47 devstack sudo[111091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d4613ab-7078-46b7-bb97-d260ff2ffa85_ofj88hvn Jun 16 09:03:47 devstack sudo[111091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c7fe0f-7544-49e4-af11-1cc415d05d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1223055069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9e1610-41a5-4f33-a923-0206e7bea9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfcdb3dadd34d03ac78390a77d740f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:47Z,use_quota=True,user_id='6c2641661fb54b018c397d586752f8d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96ad6b2-c97d-4126-ac20-558e02577bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96ad6b2-c97d-4126-ac20-558e02577bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed8fd6b-ef09-44bb-9988-e2bce2ff3443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed8fd6b-ef09-44bb-9988-e2bce2ff3443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f9e1610-41a5-4f33-a923-0206e7bea9a2', 'volume_name': 'volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe752fb-de05-4cb9-9451-f311a1efcc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe752fb-de05-4cb9-9451-f311a1efcc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc9ea87-dc6d-4aa9-8316-1c492c532cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:47 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Volume 2f9e1610-41a5-4f33-a923-0206e7bea9a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2', 'volume_size': 1} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1223055069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9e1610-41a5-4f33-a923-0206e7bea9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfcdb3dadd34d03ac78390a77d740f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:47Z,use_quota=True,user_id='6c2641661fb54b018c397d586752f8d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Creating volume 2f9e1610-41a5-4f33-a923-0206e7bea9a2 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:03:47 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:47 devstack sudo[111097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 1073741824 Jun 16 09:03:47 devstack sudo[111097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:47 devstack sudo[111083]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1da28801-200b-429a-b1cc-bade52dfd26c" returned: 0 in 0.902s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1da28801-200b-429a-b1cc-bade52dfd26c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:47 devstack sudo[111099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1da28801-200b-429a-b1cc-bade52dfd26c Jun 16 09:03:47 devstack sudo[111099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:47 devstack sudo[111090]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-a0e353ee-9868-4ef4-b7fe-eaee40d10055" returned: 0 in 0.690s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-quobyte-a0e353ee-9868-4ef4-b7fe-eaee40d10055" released by "delete_volume" :: held 2.036s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Created reservations ['ba05a8dc-3197-4821-a726-727da5d6f2b5', '1ea737aa-1984-43a7-9dd8-ca783aa9ae1a', 'a31b3bcf-b3e0-49ec-b119-3fbc810bb2e4', 'b6f8a21f-adaf-4d39-91da-55dec1d3812f'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:47 devstack sudo[111107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:47 devstack sudo[111107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:47 devstack sudo[111091]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d4613ab-7078-46b7-bb97-d260ff2ffa85_ofj88hvn" returned: 0 in 0.883s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d4613ab-7078-46b7-bb97-d260ff2ffa85_ofj88hvn {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:47 devstack sudo[111110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d4613ab-7078-46b7-bb97-d260ff2ffa85_ofj88hvn Jun 16 09:03:47 devstack sudo[111110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:47 devstack sudo[111099]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1da28801-200b-429a-b1cc-bade52dfd26c" returned: 0 in 0.752s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:47 devstack sudo[111097]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-quobyte-1da28801-200b-429a-b1cc-bade52dfd26c" released by "delete_volume" :: held 1.727s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 1073741824" returned: 0 in 0.836s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] Created reservations ['1e83e890-bbfa-4d01-bc03-bb0c2147aa69', 'a22a9209-6197-45ef-8e7d-ac9fd1d737f7', '7e99c5ae-cb0b-4072-a296-767acea13a50', '611d1477-d291-4c0c-ba0e-79cf9d3ce029'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:03:48 devstack sudo[111113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 Jun 16 09:03:48 devstack sudo[111113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:48 devstack sudo[111115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:48 devstack sudo[111115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:48 devstack sudo[111107]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.758s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:48 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Deleted volume successfully. Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f4488991-416c-4e5e-90f2-a373d8416fcf tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-a0e353ee-9868-4ef4-b7fe-eaee40d10055-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:48 devstack sudo[111110]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d4613ab-7078-46b7-bb97-d260ff2ffa85_ofj88hvn" returned: 1 in 0.762s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d4613ab-7078-46b7-bb97-d260ff2ffa85_ofj88hvn' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2a51c8-590c-4370-8243-7e070c5ecde4]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:48 devstack sudo[111120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD Jun 16 09:03:48 devstack sudo[111120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:48 devstack sudo[111113]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2" returned: 0 in 0.772s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc9ea87-dc6d-4aa9-8316-1c492c532cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56256e01-6baa-4350-82c7-9bdbb22a1fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:48 devstack sudo[111115]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.719s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "cinder-661b58ff-e8ac-4ece-b2e3-015f07f11e57-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:48 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] Deleted volume successfully. Jun 16 09:03:48 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Volume volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 (2f9e1610-41a5-4f33-a923-0206e7bea9a2): created successfully Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56256e01-6baa-4350-82c7-9bdbb22a1fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Flow 'volume_create_manager' (601dd390-b933-4cfb-acd2-5aa539e940b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:48 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-3e6c122d-02ad-402e-916e-ceac3fbd0adf tempest-SnapshotDependencyTests-917471760 None] Created volume successfully. Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5f46576c-75b1-43ed-a51c-f557184af726 tempest-CreateVolumesFromImageTest-1451662576 None] Lock "cinder-1da28801-200b-429a-b1cc-bade52dfd26c-delete_volume" released by "delete_volume" :: held 2.852s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-661b58ff-e8ac-4ece-b2e3-015f07f11e57-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "cinder-quobyte-661b58ff-e8ac-4ece-b2e3-015f07f11e57" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-quobyte-661b58ff-e8ac-4ece-b2e3-015f07f11e57" acquired by "delete_volume" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:49 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10055a1-ea4c-4b2c-95a8-8e4566b7f32e]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-661b58ff-e8ac-4ece-b2e3-015f07f11e57 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:49 devstack sudo[111125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-661b58ff-e8ac-4ece-b2e3-015f07f11e57 Jun 16 09:03:49 devstack sudo[111125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:49 devstack sudo[111120]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD" returned: 0 in 0.906s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:49 devstack sudo[111129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD Jun 16 09:03:49 devstack sudo[111129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] Creating offline snapshot 7db833d1-c3ca-4840-a576-13b45aab199b of volume 2f9e1610-41a5-4f33-a923-0206e7bea9a2 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 09:03:49 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34628f7-2754-4093-8c17-a461e1190f34]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:49 devstack sudo[111131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 Jun 16 09:03:49 devstack sudo[111131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:50 devstack sudo[111125]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-661b58ff-e8ac-4ece-b2e3-015f07f11e57" returned: 0 in 1.018s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-661b58ff-e8ac-4ece-b2e3-015f07f11e57 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:50 devstack sudo[111137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-661b58ff-e8ac-4ece-b2e3-015f07f11e57 Jun 16 09:03:50 devstack sudo[111137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:50 devstack sudo[111129]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD" returned: 1 in 0.823s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 09:03:50 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] 8d4613ab-7078-46b7-bb97-d260ff2ffa85 was raw, converting to raw {{(pid=92348) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 16 09:03:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:50 devstack sudo[111142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e Jun 16 09:03:50 devstack sudo[111142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:50 devstack sudo[111131]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2" returned: 0 in 0.944s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:50 devstack sudo[111147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b 1G Jun 16 09:03:50 devstack sudo[111147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:50 devstack sudo[111137]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-661b58ff-e8ac-4ece-b2e3-015f07f11e57" returned: 0 in 0.741s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-quobyte-661b58ff-e8ac-4ece-b2e3-015f07f11e57" released by "delete_volume" :: held 1.812s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:50 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Created reservations ['dfeeb5d3-3f77-4444-8a5a-a97d88442811', '76359fa9-40e9-45f4-81aa-73f6ae9bddf9', 'b0024a49-e734-423d-8cd7-ace36533715b', '4f2d341c-4757-4d08-a9a3-a9849a0900d6'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:03:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:50 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:50 devstack sudo[111152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:50 devstack sudo[111152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:51 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "cinder-fcf405fc-e8be-4509-8df7-9da73d2cb8ae-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:51 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-fcf405fc-e8be-4509-8df7-9da73d2cb8ae-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:51 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "cinder-quobyte-fcf405fc-e8be-4509-8df7-9da73d2cb8ae" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:51 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-quobyte-fcf405fc-e8be-4509-8df7-9da73d2cb8ae" acquired by "delete_volume" :: waited 0.020s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:51 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f93d2c-7c16-480c-accc-862be55f0464]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fcf405fc-e8be-4509-8df7-9da73d2cb8ae {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:51 devstack sudo[111142]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e" returned: 0 in 1.022s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:51 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d4613ab-7078-46b7-bb97-d260ff2ffa85_qfntsd3vdevstack@QuobyteHD, size 0.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 09:03:51 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Converted 0.00 MB image at 0.00 MB/s Jun 16 09:03:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:51 devstack sudo[111158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e 1G Jun 16 09:03:51 devstack sudo[111158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:51 devstack sudo[111156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fcf405fc-e8be-4509-8df7-9da73d2cb8ae Jun 16 09:03:51 devstack sudo[111156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:51 devstack sudo[111147]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b 1G" returned: 0 in 1.264s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:51 devstack sudo[111164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b Jun 16 09:03:51 devstack sudo[111164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:51 devstack sudo[111152]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.038s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:51 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:51 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Deleted volume successfully. Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6e0ca639-85d1-468b-9b3b-773bcdfaf314 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-661b58ff-e8ac-4ece-b2e3-015f07f11e57-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:03:52 devstack sudo[111158]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Flow 'volume_create_manager' (44eabea1-7f6c-4396-9be4-4b959c7fda70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c479ccc-14bc-48c7-be34-013b61565053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e 1G" returned: 0 in 0.890s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c479ccc-14bc-48c7-be34-013b61565053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-740229173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91550490-3de0-49e0-9850-de5908047229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f703af44d7342c0aec7388c2d0f7fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:52Z,use_quota=True,user_id='114a93a814c14f1f8daa33c30e805b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b60eda5d-3996-42fb-ad1c-39c7f7ccd184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b60eda5d-3996-42fb-ad1c-39c7f7ccd184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65eac44e-9afb-4285-a4e9-c5ffdb3e4ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65eac44e-9afb-4285-a4e9-c5ffdb3e4ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91550490-3de0-49e0-9850-de5908047229', 'volume_name': 'volume-91550490-3de0-49e0-9850-de5908047229', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf5fc48-60c0-43b1-8ad1-0d12fe39979c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf5fc48-60c0-43b1-8ad1-0d12fe39979c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d6ba2c-8c6e-42b6-9628-35c83317f534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:52 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Volume 91550490-3de0-49e0-9850-de5908047229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91550490-3de0-49e0-9850-de5908047229', 'volume_size': 1} Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86bb6b4-f0d3-4618-abf6-ca5d7258e21b]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:52 devstack sudo[111156]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fcf405fc-e8be-4509-8df7-9da73d2cb8ae" returned: 0 in 1.071s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fcf405fc-e8be-4509-8df7-9da73d2cb8ae {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:52 devstack sudo[111173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fcf405fc-e8be-4509-8df7-9da73d2cb8ae Jun 16 09:03:52 devstack sudo[111173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:52 devstack sudo[111172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e Jun 16 09:03:52 devstack sudo[111172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:52 devstack sudo[111164]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b" returned: 0 in 0.804s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:52 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b is being set with open permissions: ugo+rw Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:52 devstack sudo[111179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b Jun 16 09:03:52 devstack sudo[111179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:52 devstack sudo[111173]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fcf405fc-e8be-4509-8df7-9da73d2cb8ae" returned: 0 in 0.627s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:52 devstack sudo[111172]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e" returned: 0 in 0.725s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-quobyte-fcf405fc-e8be-4509-8df7-9da73d2cb8ae" released by "delete_volume" :: held 1.772s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Created reservations ['d0443cd9-070d-49be-8ce3-29d6c165da8c', 'af49633e-df0a-4b69-8390-d2011ffc6ffb', '875ff458-da57-4493-95e9-70d34a4cd814', '841db9c8-a717-4dfb-9d1d-e2ee13535380'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:53 devstack sudo[111184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e Jun 16 09:03:53 devstack sudo[111184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:53 devstack sudo[111186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:53 devstack sudo[111186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:53 devstack sudo[111179]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b" returned: 0 in 0.625s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:53 devstack sudo[111189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.info Jun 16 09:03:53 devstack sudo[111189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "cinder-2004fbf2-7c23-4916-a161-3dd1333b2d7f-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-2004fbf2-7c23-4916-a161-3dd1333b2d7f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "cinder-quobyte-2004fbf2-7c23-4916-a161-3dd1333b2d7f" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-quobyte-2004fbf2-7c23-4916-a161-3dd1333b2d7f" acquired by "delete_volume" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef05fda-c7ad-43a1-a1fc-32c8eebb8e40]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2004fbf2-7c23-4916-a161-3dd1333b2d7f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:53 devstack sudo[111191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2004fbf2-7c23-4916-a161-3dd1333b2d7f Jun 16 09:03:53 devstack sudo[111191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:53 devstack sudo[111184]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:53 devstack sudo[111186]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e" returned: 1 in 0.803s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Downloaded image 8d4613ab-7078-46b7-bb97-d260ff2ffa85 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d4613ab-7078-46b7-bb97-d260ff2ffa85', 'metadata': {}}])) to volume 1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e successfully. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Temporary image 8d4613ab-7078-46b7-bb97-d260ff2ffa85 for user 194a82b45b8243c4a56ff5bfb457cdbb is deleted. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Marking volume 1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e as bootable. {{(pid=92348) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.675s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:53 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Deleted volume successfully. Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Copying metadata from image 8d4613ab-7078-46b7-bb97-d260ff2ffa85 to 1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e. {{(pid=92348) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Creating volume glance metadata for volume 1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e backed by image 8d4613ab-7078-46b7-bb97-d260ff2ffa85 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8d4613ab-7078-46b7-bb97-d260ff2ffa85', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'baa1f361259eb77a671f19c08036ecf5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92348) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8313bab8-f01e-4ceb-bea5-237330c9f9c7 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-fcf405fc-e8be-4509-8df7-9da73d2cb8ae-delete_volume" released by "delete_volume" :: held 2.714s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb04160-1854-4b1b-83a4-d05642a8098b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e', 'volume_size': 1, 'image_id': '8d4613ab-7078-46b7-bb97-d260ff2ffa85', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d4613ab-7078-46b7-bb97-d260ff2ffa85', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'baa1f361259eb77a671f19c08036ecf5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '084954b6cbf143c09f0638da7663d0d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3d01a5efd4c69283e13ae93ed80414d5c07025a7d71124ab29944e29698e9322da8898002abc0d5e4578c2fd6ab9b0777159992ac893e9d07a199647911daec', 'id': '8d4613ab-7078-46b7-bb97-d260ff2ffa85', 'created_at': datetime.datetime(2026, 6, 16, 7, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 7, 3, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d4613ab-7078-46b7-bb97-d260ff2ffa85/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80296e7-46b6-4aad-95ab-facfde5acfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:53 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Volume volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e (1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e): created successfully Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80296e7-46b6-4aad-95ab-facfde5acfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:53 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Flow 'volume_create_manager' (910f046b-915f-4d58-be73-c906e06b4b9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:53 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-02a3866a-2e8c-4262-94a7-fccaf32ea292 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Created volume successfully. Jun 16 09:03:54 devstack sudo[111189]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.info" returned: 0 in 0.742s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:54 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.info is being set with open permissions: ugo+rw Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:54 devstack sudo[111198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.info Jun 16 09:03:54 devstack sudo[111198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:54 devstack sudo[111191]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2004fbf2-7c23-4916-a161-3dd1333b2d7f" returned: 0 in 0.794s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2004fbf2-7c23-4916-a161-3dd1333b2d7f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:54 devstack sudo[111203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2004fbf2-7c23-4916-a161-3dd1333b2d7f Jun 16 09:03:54 devstack sudo[111203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:54 devstack sudo[111198]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.info" returned: 0 in 0.621s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.116s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.494s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-740229173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91550490-3de0-49e0-9850-de5908047229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f703af44d7342c0aec7388c2d0f7fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:52Z,use_quota=True,user_id='114a93a814c14f1f8daa33c30e805b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Creating volume 91550490-3de0-49e0-9850-de5908047229 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:03:54 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:54 devstack sudo[111206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 1073741824 Jun 16 09:03:54 devstack sudo[111206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:54 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-678e3fbd-7ae4-49db-9e56-0cf42ee1ea57 tempest-SnapshotDependencyTests-917471760 None] Create snapshot completed successfully Jun 16 09:03:54 devstack sudo[111203]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2004fbf2-7c23-4916-a161-3dd1333b2d7f" returned: 0 in 0.624s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-quobyte-2004fbf2-7c23-4916-a161-3dd1333b2d7f" released by "delete_volume" :: held 1.485s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Created reservations ['a8cc7bdc-38d5-4cf3-9340-b64e6e3724e1', '94596d11-841e-4527-b15a-687a2dec661d', '0d5da719-ca1b-44a5-9aa4-a9f201488be6', '8df3d7d0-4d1a-4500-a200-1b95ff1adfaa'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Acquiring lock "cinder-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Lock "cinder-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Acquiring lock "cinder-quobyte-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Lock "cinder-quobyte-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e" acquired by "delete_volume" :: waited 0.040s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:55 devstack sudo[111209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:55 devstack sudo[111209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4ccb6b-c026-4ea3-9915-3822d37f663d]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:55 devstack sudo[111211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e Jun 16 09:03:55 devstack sudo[111211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:55 devstack sudo[111206]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 1073741824" returned: 0 in 0.908s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "cinder-0ba237aa-2f83-4927-904a-f5d61de62461-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:55 devstack sudo[111217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 Jun 16 09:03:55 devstack sudo[111217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Flow 'volume_create_manager' (1b172c24-3f51-41e8-aabc-676290640b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8bf4d3-ca4b-4ae5-8bd0-180f57e08a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-0ba237aa-2f83-4927-904a-f5d61de62461-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8bf4d3-ca4b-4ae5-8bd0-180f57e08a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066582b3-691e-44b5-9479-12dc72344c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cfcdb3dadd34d03ac78390a77d740f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7db833d1-c3ca-4840-a576-13b45aab199b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:03:56Z,use_quota=True,user_id='6c2641661fb54b018c397d586752f8d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36f9cde-56d6-4614-8e04-9dd786cfb362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36f9cde-56d6-4614-8e04-9dd786cfb362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1a1d2c-d22d-46c1-b664-436ed8ba6df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1a1d2c-d22d-46c1-b664-436ed8ba6df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '066582b3-691e-44b5-9479-12dc72344c4c', 'volume_name': 'volume-066582b3-691e-44b5-9479-12dc72344c4c', 'volume_size': 1, 'snapshot_id': '7db833d1-c3ca-4840-a576-13b45aab199b'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc45a13-1751-432e-a2b5-0216a0329149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbc45a13-1751-432e-a2b5-0216a0329149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f1ed96-af40-4236-88d8-fa686ef4c773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:55 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Volume 066582b3-691e-44b5-9479-12dc72344c4c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-066582b3-691e-44b5-9479-12dc72344c4c', 'volume_size': 1, 'snapshot_id': '7db833d1-c3ca-4840-a576-13b45aab199b'} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "cinder-quobyte-0ba237aa-2f83-4927-904a-f5d61de62461" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:55 devstack sudo[111209]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.720s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:55 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Deleted volume successfully. Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-quobyte-0ba237aa-2f83-4927-904a-f5d61de62461" acquired by "delete_volume" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-46df097a-8285-4812-9e4f-e0b9630d12f3 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-2004fbf2-7c23-4916-a161-3dd1333b2d7f-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e850cb-0c0e-4010-b035-94f535a6dd79]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:55 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0ba237aa-2f83-4927-904a-f5d61de62461 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:56 devstack sudo[111220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0ba237aa-2f83-4927-904a-f5d61de62461 Jun 16 09:03:56 devstack sudo[111220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:56 devstack sudo[111211]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e" returned: 0 in 0.882s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:56 devstack sudo[111224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e Jun 16 09:03:56 devstack sudo[111224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:56 devstack sudo[111217]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229" returned: 0 in 0.734s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.592s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Acquiring lock "cinder-quobyte-7db833d1-c3ca-4840-a576-13b45aab199b-066582b3-691e-44b5-9479-12dc72344c4c" by "_create_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d6ba2c-8c6e-42b6-9628-35c83317f534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91550490-3de0-49e0-9850-de5908047229', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a888eab3-7576-4eec-a712-06bfa6aa97dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-quobyte-7db833d1-c3ca-4840-a576-13b45aab199b-066582b3-691e-44b5-9479-12dc72344c4c" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Creating volume 066582b3-691e-44b5-9479-12dc72344c4c from snapshot 7db833d1-c3ca-4840-a576-13b45aab199b {{(pid=92348) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Acquiring lock "cinder-quobyte-066582b3-691e-44b5-9479-12dc72344c4c" by "_copy_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-quobyte-066582b3-691e-44b5-9479-12dc72344c4c" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] snapshot: 7db833d1-c3ca-4840-a576-13b45aab199b, volume: 066582b3-691e-44b5-9479-12dc72344c4c, {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 16 09:03:56 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Volume volume-91550490-3de0-49e0-9850-de5908047229 (91550490-3de0-49e0-9850-de5908047229): created successfully Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a888eab3-7576-4eec-a712-06bfa6aa97dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Flow 'volume_create_manager' (44eabea1-7f6c-4396-9be4-4b959c7fda70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:56 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-696ff884-4027-46d9-bf4c-fa4540de4f6b tempest-VolumeDependencyTests-137865675 None] Created volume successfully. Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeeddd47-a3de-49d7-ac18-3c2ec65c996b]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:56 devstack sudo[111235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b Jun 16 09:03:56 devstack sudo[111235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:56 devstack sudo[111220]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0ba237aa-2f83-4927-904a-f5d61de62461" returned: 0 in 0.798s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0ba237aa-2f83-4927-904a-f5d61de62461 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:56 devstack sudo[111239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0ba237aa-2f83-4927-904a-f5d61de62461 Jun 16 09:03:56 devstack sudo[111239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:56 devstack sudo[111224]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e" returned: 1 in 0.735s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 09:03:56 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:56 devstack sudo[111244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e Jun 16 09:03:56 devstack sudo[111244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:57 devstack sudo[111235]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b" returned: 0 in 0.749s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Creating direct copy from snapshot {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55da660-70eb-48aa-bb7f-bae242b007a6]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:57 devstack sudo[111239]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-0ba237aa-2f83-4927-904a-f5d61de62461" returned: 0 in 0.644s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-quobyte-0ba237aa-2f83-4927-904a-f5d61de62461" released by "delete_volume" :: held 1.505s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Created reservations ['a3bfc03e-eda1-4068-bee1-410d6c3d0924', '0e7f9c76-0a99-482f-beb5-794dbd33e512', 'a6f5ef31-4b7f-4ac9-a296-52e3ad6458d3', 'a6b95a23-a002-472f-b661-95a60d5bd6d7'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:03:57 devstack sudo[111251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 Jun 16 09:03:57 devstack sudo[111251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:57 devstack sudo[111244]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e" returned: 0 in 0.655s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Lock "cinder-quobyte-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e" released by "delete_volume" :: held 2.402s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:57 devstack sudo[111254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:57 devstack sudo[111254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Created reservations ['7533ea2b-c8bb-44ba-aafc-f0aa80c0d0a5', 'daa6dd71-57a0-48cf-b1e9-3971a80a705e', '06e6da8c-c429-45f1-8b53-99576a9f6e5c', 'a93060dc-22b5-4e36-b911-3b4533c98eea'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:03:57 devstack sudo[111256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:03:57 devstack sudo[111256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "cinder-fd3a40a5-95fc-44ca-9ffe-a6071d704fea-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:57 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-fd3a40a5-95fc-44ca-9ffe-a6071d704fea-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "cinder-quobyte-fd3a40a5-95fc-44ca-9ffe-a6071d704fea" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:03:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-quobyte-fd3a40a5-95fc-44ca-9ffe-a6071d704fea" acquired by "delete_volume" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:03:58 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e217fcc-121c-4982-9e98-d9164581db2d]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:03:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fd3a40a5-95fc-44ca-9ffe-a6071d704fea {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:58 devstack sudo[111251]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2" returned: 0 in 0.828s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:58 devstack cinder-volume[92348]: DEBUG cinder.utils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Path /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-066582b3-691e-44b5-9479-12dc72344c4c not found in is_blk_device check {{(pid=92348) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 16 09:03:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-066582b3-691e-44b5-9479-12dc72344c4c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:58 devstack sudo[111261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fd3a40a5-95fc-44ca-9ffe-a6071d704fea Jun 16 09:03:58 devstack sudo[111261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:58 devstack sudo[111263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-066582b3-691e-44b5-9479-12dc72344c4c Jun 16 09:03:58 devstack sudo[111263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:03:58 devstack sudo[111254]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.707s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:58 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:58 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Deleted volume successfully. Jun 16 09:03:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-721c9fbf-563c-4f06-a09a-e2b86c844355 tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-0ba237aa-2f83-4927-904a-f5d61de62461-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:58 devstack sudo[111256]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:58 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.733s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:58 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:03:58 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Deleted volume successfully. Jun 16 09:03:58 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-12a5a82b-1797-41f6-905d-ee8b2d319034 tempest-VolumeAndVolumeTypeFromImageTest-1401927811 None] Lock "cinder-1b7bb77e-c69b-45c9-8e0a-87cc0784bf7e-delete_volume" released by "delete_volume" :: held 3.466s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:03:59 devstack sudo[111261]: pam_unix(sudo:session): session closed for user root Jun 16 09:03:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fd3a40a5-95fc-44ca-9ffe-a6071d704fea" returned: 0 in 0.912s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:03:59 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fd3a40a5-95fc-44ca-9ffe-a6071d704fea {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:03:59 devstack sudo[111280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fd3a40a5-95fc-44ca-9ffe-a6071d704fea Jun 16 09:03:59 devstack sudo[111280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:00 devstack sudo[111280]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:00 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-fd3a40a5-95fc-44ca-9ffe-a6071d704fea" returned: 0 in 1.701s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:00 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-quobyte-fd3a40a5-95fc-44ca-9ffe-a6071d704fea" released by "delete_volume" :: held 2.687s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:00 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Created reservations ['afe61969-20d1-4dfd-9c6c-b3fd457e4d49', '738619a1-b732-4482-a46c-34bca20e7c9e', '31c41ddb-2ab9-48c0-8b88-0f799c4e9b90', 'b64d48cc-9173-401f-8996-bc7e1e393863'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:01 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:01 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:01 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:01 devstack sudo[111286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:04:01 devstack sudo[111286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:02 devstack sudo[111286]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:02 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.271s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:02 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:04:02 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Deleted volume successfully. Jun 16 09:04:02 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-d391ee40-3f02-46f0-ab20-5dd7b95cedea tempest-CreateVolumesFromSourceVolumeTest-1584722137 None] Lock "cinder-fd3a40a5-95fc-44ca-9ffe-a6071d704fea-delete_volume" released by "delete_volume" :: held 4.536s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:04 devstack sudo[111263]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-066582b3-691e-44b5-9479-12dc72344c4c" returned: 0 in 6.161s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:04 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faf74e3-c5d6-4a18-9179-ce53f4d79975]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:04 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:04 devstack sudo[111289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 Jun 16 09:04:04 devstack sudo[111289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:05 devstack sudo[111289]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2" returned: 0 in 0.905s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:05 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-066582b3-691e-44b5-9479-12dc72344c4c {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 09:04:05 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Converted 1024.00 MB image at 166.17 MB/s Jun 16 09:04:05 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-066582b3-691e-44b5-9479-12dc72344c4c is being set with open permissions: ugo+rw Jun 16 09:04:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-066582b3-691e-44b5-9479-12dc72344c4c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:05 devstack sudo[111294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-066582b3-691e-44b5-9479-12dc72344c4c Jun 16 09:04:05 devstack sudo[111294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:05 devstack sudo[111294]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-066582b3-691e-44b5-9479-12dc72344c4c" returned: 0 in 0.671s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-quobyte-066582b3-691e-44b5-9479-12dc72344c4c" released by "_copy_volume_from_snapshot" :: held 9.452s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:05 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-quobyte-7db833d1-c3ca-4840-a576-13b45aab199b-066582b3-691e-44b5-9479-12dc72344c4c" released by "_create_volume_from_snapshot" :: held 9.487s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.517s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:05 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.198s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] Creating offline snapshot ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 of volume 91550490-3de0-49e0-9850-de5908047229 {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f1ed96-af40-4236-88d8-fa686ef4c773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-066582b3-691e-44b5-9479-12dc72344c4c', 'volume_size': 1, 'snapshot_id': '7db833d1-c3ca-4840-a576-13b45aab199b'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a873140-3dd6-4b05-b866-cbe3a4588af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b91de2c-6717-4349-99fe-64ba8fa5f26d]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:06 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Volume volume-066582b3-691e-44b5-9479-12dc72344c4c (066582b3-691e-44b5-9479-12dc72344c4c): created successfully Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a873140-3dd6-4b05-b866-cbe3a4588af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Flow 'volume_create_manager' (1b172c24-3f51-41e8-aabc-676290640b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:06 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4082e6f7-f99d-437b-ba19-07bb50279866 tempest-SnapshotDependencyTests-917471760 None] Created volume successfully. Jun 16 09:04:06 devstack sudo[111297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 Jun 16 09:04:06 devstack sudo[111297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Flow 'volume_create_manager' (145f466f-9ad4-4913-82a2-6e25e911fbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0269d82e-4e9c-4fef-a3ff-f1b8fc8d1cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0269d82e-4e9c-4fef-a3ff-f1b8fc8d1cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2021709093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8563c81-ca4a-40ca-9e91-c9c51ffc0dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627a90d313da467384122b883f55ab2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:06Z,use_quota=True,user_id='a8c434b58c9e40119663d5d187c3e932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9189a7c-e734-417c-8417-a4dd8c5ff6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9189a7c-e734-417c-8417-a4dd8c5ff6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc2c49b-adce-452c-9b74-e40cf2c5e5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bc2c49b-adce-452c-9b74-e40cf2c5e5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8563c81-ca4a-40ca-9e91-c9c51ffc0dda', 'volume_name': 'volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df4a3cc-ac64-4fae-b245-ef5e46b0df26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df4a3cc-ac64-4fae-b245-ef5e46b0df26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d7350d-2030-4623-aac1-a5e8b8a5c98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:06 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume d8563c81-ca4a-40ca-9e91-c9c51ffc0dda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda', 'volume_size': 1} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] Acquiring lock "cinder-7db833d1-c3ca-4840-a576-13b45aab199b-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-7db833d1-c3ca-4840-a576-13b45aab199b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] Acquiring lock "cinder-quobyte-2f9e1610-41a5-4f33-a923-0206e7bea9a2" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-quobyte-2f9e1610-41a5-4f33-a923-0206e7bea9a2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] Acquiring lock "cinder-quobyte-7db833d1-c3ca-4840-a576-13b45aab199b" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-quobyte-7db833d1-c3ca-4840-a576-13b45aab199b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] Deleting offline snapshot 7db833d1-c3ca-4840-a576-13b45aab199b of volume 2f9e1610-41a5-4f33-a923-0206e7bea9a2 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] snapshot_file for this snap is: volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[11368332-e576-4d20-a4e9-e320186914b7]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:06 devstack sudo[111297]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229" returned: 0 in 0.825s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:06 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:06 devstack sudo[111303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 1G Jun 16 09:04:06 devstack sudo[111303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:06 devstack sudo[111302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b Jun 16 09:04:06 devstack sudo[111302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:07 devstack sudo[111302]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b" returned: 0 in 0.729s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:07 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 09:04:07 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[16740f77-eb32-4e95-bdf1-fa0faf521a69]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:07 devstack sudo[111313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 Jun 16 09:04:07 devstack sudo[111313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:07 devstack sudo[111303]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 1G" returned: 0 in 0.840s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:07 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91550490-3de0-49e0-9850-de5908047229 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:07 devstack sudo[111315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91550490-3de0-49e0-9850-de5908047229 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 Jun 16 09:04:07 devstack sudo[111315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:08 devstack sudo[111313]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2" returned: 0 in 0.702s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:08 devstack sudo[111323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b Jun 16 09:04:08 devstack sudo[111323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:08 devstack sudo[111315]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91550490-3de0-49e0-9850-de5908047229 -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5" returned: 0 in 0.687s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:08 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 is being set with open permissions: ugo+rw Jun 16 09:04:08 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:08 devstack sudo[111325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 Jun 16 09:04:08 devstack sudo[111325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:08 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:04:08 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Flow 'volume_create_manager' (800b5b38-d24e-40fd-89ab-4951011639ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:08 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863ca2d0-d881-40c6-9025-d9e29fbfe02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:08 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863ca2d0-d881-40c6-9025-d9e29fbfe02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2766fee-a890-4aac-91bb-2d6b9869d9e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cc46dc91be4e3dbaeb5bb2398c9b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:09Z,use_quota=True,user_id='8d10bcb9af21465c8768dbf83ee45229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:08 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83985a18-67c1-4723-8d25-ef6d5f1f9d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:08 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83985a18-67c1-4723-8d25-ef6d5f1f9d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:08 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85cc0eae-c0d9-49b8-b82a-eba253af61a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:08 devstack cinder-volume[92348]: DEBUG cinder.image.glance [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Creating Keystone auth plugin from conf {{(pid=92348) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 16 09:04:09 devstack sudo[111323]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b" returned: 0 in 0.767s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:09 devstack sudo[111332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b Jun 16 09:04:09 devstack sudo[111332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85cc0eae-c0d9-49b8-b82a-eba253af61a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e2766fee-a890-4aac-91bb-2d6b9869d9e7', 'volume_name': 'volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7', 'volume_size': 1, 'image_id': '983df83a-58b3-45f3-96ca-8595383636d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/983df83a-58b3-45f3-96ca-8595383636d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ca67673d41df05eaabde0e34021ae5a1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23cc46dc91be4e3dbaeb5bb2398c9b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05bec5ca9b32206bfb786363a1dabc0ebd38ceac180a84bdb52bc1ec5799358f179c8d7258db35b160b91cb1d7587b90bcd0107dfdd0ebb0285b1606b3a6b950', 'id': '983df83a-58b3-45f3-96ca-8595383636d7', 'created_at': datetime.datetime(2026, 6, 16, 7, 4, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 7, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/983df83a-58b3-45f3-96ca-8595383636d7/file', 'properties': {}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c11880-b162-4189-8f9c-93156589a58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c11880-b162-4189-8f9c-93156589a58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:09 devstack sudo[111325]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c659caf-f5a8-4031-936a-2e83e45e05e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:09 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Volume e2766fee-a890-4aac-91bb-2d6b9869d9e7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7', 'volume_size': 1, 'image_id': '983df83a-58b3-45f3-96ca-8595383636d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/983df83a-58b3-45f3-96ca-8595383636d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ca67673d41df05eaabde0e34021ae5a1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23cc46dc91be4e3dbaeb5bb2398c9b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05bec5ca9b32206bfb786363a1dabc0ebd38ceac180a84bdb52bc1ec5799358f179c8d7258db35b160b91cb1d7587b90bcd0107dfdd0ebb0285b1606b3a6b950', 'id': '983df83a-58b3-45f3-96ca-8595383636d7', 'created_at': datetime.datetime(2026, 6, 16, 7, 4, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 7, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/983df83a-58b3-45f3-96ca-8595383636d7/file', 'properties': {}}, 'image_service': } Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Trying to clone e2766fee-a890-4aac-91bb-2d6b9869d9e7 from image 983df83a-58b3-45f3-96ca-8595383636d7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/983df83a-58b3-45f3-96ca-8595383636d7', 'metadata': {}}]). {{(pid=92348) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5" returned: 0 in 0.712s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:09 devstack sudo[111334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.info Jun 16 09:04:09 devstack sudo[111334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 16 09:04:09 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Image download 0.00 MB at 0.00 MB/s Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7823a2-b6e7-4d3e-91a7-42096888fa13]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:09 devstack sudo[111336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD Jun 16 09:04:09 devstack sudo[111336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:09 devstack sudo[111332]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2.7db833d1-c3ca-4840-a576-13b45aab199b" returned: 0 in 0.663s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-quobyte-7db833d1-c3ca-4840-a576-13b45aab199b" released by "_delete_snapshot" :: held 2.985s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-quobyte-2f9e1610-41a5-4f33-a923-0206e7bea9a2" released by "delete_snapshot" :: held 3.012s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:09 devstack sudo[111334]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.info" returned: 0 in 0.663s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:09 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.info is being set with open permissions: ugo+rw Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:09 devstack sudo[111340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.info Jun 16 09:04:09 devstack sudo[111340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] Created reservations ['1c6b7077-583d-4993-9beb-97deabc080e6', 'a1e1bc90-6e59-4e8b-ba9d-5f8f960d5d81', '965a42f9-ae50-4830-9131-68bfaffd7509', '3bc61089-5c43-442e-a810-666ad200d609'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:09 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] Delete snapshot completed successfully. Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-be76c9ac-edd2-4976-ab1d-bc79052c6bc8 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-7db833d1-c3ca-4840-a576-13b45aab199b-delete_snapshot" released by "delete_snapshot" :: held 3.181s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:09 devstack sudo[111336]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:09 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:10 devstack sudo[111344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD Jun 16 09:04:10 devstack sudo[111344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:10 devstack sudo[111340]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.info" returned: 0 in 0.630s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.482s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.922s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2021709093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8563c81-ca4a-40ca-9e91-c9c51ffc0dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627a90d313da467384122b883f55ab2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:06Z,use_quota=True,user_id='a8c434b58c9e40119663d5d187c3e932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Creating volume d8563c81-ca4a-40ca-9e91-c9c51ffc0dda {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:04:10 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:10 devstack sudo[111347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda 1073741824 Jun 16 09:04:10 devstack sudo[111347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:10 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-3716b80c-04d6-4e50-b8de-fea84efd44bd tempest-VolumeDependencyTests-137865675 None] Create snapshot completed successfully Jun 16 09:04:10 devstack sudo[111344]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD" returned: 1 in 0.707s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Temporary image 983df83a-58b3-45f3-96ca-8595383636d7 is fetched for user 8d10bcb9af21465c8768dbf83ee45229. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f784d23d-ed07-4666-93b4-07b1d2676b0b]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:10 devstack sudo[111352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD Jun 16 09:04:10 devstack sudo[111352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:10 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] Acquiring lock "cinder-2f9e1610-41a5-4f33-a923-0206e7bea9a2-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-2f9e1610-41a5-4f33-a923-0206e7bea9a2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] Acquiring lock "cinder-quobyte-2f9e1610-41a5-4f33-a923-0206e7bea9a2" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:11 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-quobyte-2f9e1610-41a5-4f33-a923-0206e7bea9a2" acquired by "delete_volume" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:11 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[8309a9fa-bcb7-4c61-a679-2a91fc11e7ad]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:11 devstack sudo[111358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 Jun 16 09:04:11 devstack sudo[111358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:11 devstack sudo[111347]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda 1073741824" returned: 0 in 0.901s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:11 devstack sudo[111360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda Jun 16 09:04:11 devstack sudo[111360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:11 devstack sudo[111352]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD" returned: 0 in 0.793s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:11 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:11 devstack sudo[111364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD Jun 16 09:04:11 devstack sudo[111364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:12 devstack sudo[111358]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2" returned: 0 in 0.879s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:12 devstack sudo[111402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2 Jun 16 09:04:12 devstack sudo[111402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Flow 'volume_create_manager' (8690cd13-dfc3-46bf-93ea-4d2e89e6ffc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72acf5b4-f478-4064-902b-8a56315e2229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72acf5b4-f478-4064-902b-8a56315e2229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-518447804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1fd2aa0-219a-4fcb-b47a-0142972bf09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f703af44d7342c0aec7388c2d0f7fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:12Z,use_quota=True,user_id='114a93a814c14f1f8daa33c30e805b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cc0b83-3e4c-4eb8-8465-6f1bffd78999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cc0b83-3e4c-4eb8-8465-6f1bffd78999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1e14f3-0530-412d-a9ee-459aa2d2f05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1e14f3-0530-412d-a9ee-459aa2d2f05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e1fd2aa0-219a-4fcb-b47a-0142972bf09d', 'volume_name': 'volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d', 'volume_size': 1, 'snapshot_id': 'ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe7a8f8-c7a3-4d25-9778-f1832ecedef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe7a8f8-c7a3-4d25-9778-f1832ecedef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34029de8-0436-43ae-9b5a-acf5aa1010ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:12 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Volume e1fd2aa0-219a-4fcb-b47a-0142972bf09d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d', 'volume_size': 1, 'snapshot_id': 'ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5'} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:12 devstack sudo[111360]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda" returned: 0 in 1.070s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.015s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Acquiring lock "cinder-quobyte-ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5-e1fd2aa0-219a-4fcb-b47a-0142972bf09d" by "_create_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d7350d-2030-4623-aac1-a5e8b8a5c98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c532a8a4-1ba4-4611-97aa-e53a3fff7bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-quobyte-ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5-e1fd2aa0-219a-4fcb-b47a-0142972bf09d" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Creating volume e1fd2aa0-219a-4fcb-b47a-0142972bf09d from snapshot ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 {{(pid=92348) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Acquiring lock "cinder-quobyte-e1fd2aa0-219a-4fcb-b47a-0142972bf09d" by "_copy_volume_from_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:12 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda (d8563c81-ca4a-40ca-9e91-c9c51ffc0dda): created successfully Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c532a8a4-1ba4-4611-97aa-e53a3fff7bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:12 devstack sudo[111364]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Flow 'volume_create_manager' (145f466f-9ad4-4913-82a2-6e25e911fbb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-quobyte-e1fd2aa0-219a-4fcb-b47a-0142972bf09d" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] snapshot: ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5, volume: e1fd2aa0-219a-4fcb-b47a-0142972bf09d, {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD" returned: 1 in 1.029s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:12 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-cb9bccdb-6b37-461a-b225-c7afb8005110 tempest-CreateVolumesFromSnapshotTest-163426016 None] Created volume successfully. Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a5b447-eaaf-4e6e-a711-2d20fa7f9f31]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:12 devstack sudo[111412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 Jun 16 09:04:12 devstack sudo[111412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:12 devstack sudo[111402]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-2f9e1610-41a5-4f33-a923-0206e7bea9a2" returned: 0 in 0.834s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-quobyte-2f9e1610-41a5-4f33-a923-0206e7bea9a2" released by "delete_volume" :: held 1.777s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:12 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] Created reservations ['e3effa2a-670c-4f79-bcbf-2ae19e2803dc', '387f6ca3-b047-45ee-b40b-cd68da135209', 'ce522311-7b9d-4f83-aa7b-724a115da85f', '0abb1e50-3912-4abe-909f-697a4c16cff8'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:13 devstack sudo[111415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:04:13 devstack sudo[111415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] Acquiring lock "cinder-066582b3-691e-44b5-9479-12dc72344c4c-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-066582b3-691e-44b5-9479-12dc72344c4c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:13 devstack sudo[111412]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5" returned: 0 in 0.813s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91550490-3de0-49e0-9850-de5908047229(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Creating direct copy from snapshot {{(pid=92348) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac6db19-f97d-4496-b0e1-d0b6e1d9bb0c]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] Acquiring lock "cinder-quobyte-066582b3-691e-44b5-9479-12dc72344c4c" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-quobyte-066582b3-691e-44b5-9479-12dc72344c4c" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3e2b55-bee9-4104-b8d3-707ad4ed5691]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-066582b3-691e-44b5-9479-12dc72344c4c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:13 devstack sudo[111420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 Jun 16 09:04:13 devstack sudo[111420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:13 devstack sudo[111421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-066582b3-691e-44b5-9479-12dc72344c4c Jun 16 09:04:13 devstack sudo[111421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:13 devstack sudo[111415]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.740s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:04:13 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] Deleted volume successfully. Jun 16 09:04:13 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b5d60105-3417-4fcf-812c-a3971c52d1a7 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-2f9e1610-41a5-4f33-a923-0206e7bea9a2-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:14 devstack sudo[111420]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229" returned: 0 in 0.823s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:14 devstack cinder-volume[92348]: DEBUG cinder.utils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Path /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d not found in is_blk_device check {{(pid=92348) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 16 09:04:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:14 devstack sudo[111421]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-066582b3-691e-44b5-9479-12dc72344c4c" returned: 0 in 0.731s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-066582b3-691e-44b5-9479-12dc72344c4c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:14 devstack sudo[111432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d Jun 16 09:04:14 devstack sudo[111432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:14 devstack sudo[111434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-066582b3-691e-44b5-9479-12dc72344c4c Jun 16 09:04:14 devstack sudo[111434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:14 devstack sudo[111434]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:14 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-066582b3-691e-44b5-9479-12dc72344c4c" returned: 0 in 0.645s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:14 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-quobyte-066582b3-691e-44b5-9479-12dc72344c4c" released by "delete_volume" :: held 1.433s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:15 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] Created reservations ['82bf5f26-dc24-4d8e-8c51-820d450b24c1', '25057318-a0bd-4ed5-9258-264aadb30e07', 'a22bf30f-1793-43ec-9f9a-1ce418ca7b20', 'b1f2fcf2-3bde-4c9e-81e7-de82c563b48b'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:15 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:15 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:15 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:15 devstack sudo[111447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:04:15 devstack sudo[111447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:16 devstack sudo[111447]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:16 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.094s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:16 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:04:16 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] Deleted volume successfully. Jun 16 09:04:16 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-eac3c085-2c82-4fec-9ef4-ced847d83717 tempest-SnapshotDependencyTests-917471760 None] Lock "cinder-066582b3-691e-44b5-9479-12dc72344c4c-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:19 devstack sudo[111432]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d" returned: 0 in 5.230s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:19 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba25c967-73c6-4ead-a9a6-090b66e6914b]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:19 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:19 devstack sudo[111453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 Jun 16 09:04:19 devstack sudo[111453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:20 devstack sudo[111453]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229" returned: 0 in 0.925s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:20 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229, size 1024.00 MB, duration 5.23 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 09:04:20 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Converted 1024.00 MB image at 195.76 MB/s Jun 16 09:04:20 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d is being set with open permissions: ugo+rw Jun 16 09:04:20 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:20 devstack sudo[111458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d Jun 16 09:04:20 devstack sudo[111458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:21 devstack sudo[111458]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d" returned: 0 in 0.609s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-quobyte-e1fd2aa0-219a-4fcb-b47a-0142972bf09d" released by "_copy_volume_from_snapshot" :: held 8.518s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-quobyte-ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5-e1fd2aa0-219a-4fcb-b47a-0142972bf09d" released by "_create_volume_from_snapshot" :: held 8.567s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.606s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.528s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2766fee-a890-4aac-91bb-2d6b9869d9e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cc46dc91be4e3dbaeb5bb2398c9b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:09Z,use_quota=True,user_id='8d10bcb9af21465c8768dbf83ee45229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Creating volume e2766fee-a890-4aac-91bb-2d6b9869d9e7 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:04:21 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:21 devstack sudo[111461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 1073741824 Jun 16 09:04:21 devstack sudo[111461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34029de8-0436-43ae-9b5a-acf5aa1010ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d', 'volume_size': 1, 'snapshot_id': 'ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5'}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65620789-5055-4752-9951-0d25714af4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:21 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Volume volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d (e1fd2aa0-219a-4fcb-b47a-0142972bf09d): created successfully Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65620789-5055-4752-9951-0d25714af4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Flow 'volume_create_manager' (8690cd13-dfc3-46bf-93ea-4d2e89e6ffc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:21 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c66f3d07-d684-4b86-b4e8-0e71264eed50 tempest-VolumeDependencyTests-137865675 None] Created volume successfully. Jun 16 09:04:21 devstack sudo[111461]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 1073741824" returned: 0 in 0.791s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=123,cinder:UPDATE=170,cinder:INSERT=46,cinder:DELETE=16 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 09:04:21 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:21 devstack sudo[111468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 Jun 16 09:04:21 devstack sudo[111468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] Acquiring lock "cinder-ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] Acquiring lock "cinder-quobyte-91550490-3de0-49e0-9850-de5908047229" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-quobyte-91550490-3de0-49e0-9850-de5908047229" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] Acquiring lock "cinder-quobyte-ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-quobyte-ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] Deleting offline snapshot ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 of volume 91550490-3de0-49e0-9850-de5908047229 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] snapshot_file for this snap is: volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c3a370-0d7d-4d73-9605-6cfe460925e4]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:22 devstack sudo[111470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 Jun 16 09:04:22 devstack sudo[111470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:22 devstack sudo[111468]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7" returned: 0 in 0.615s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.437s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=132,cinder:UPDATE=176,cinder:DELETE=17,cinder:INSERT=43 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] Creating offline snapshot 0328a27b-f1d5-471c-a8fd-59b6e0edc2ba of volume d8563c81-ca4a-40ca-9e91-c9c51ffc0dda {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Attempting download of 983df83a-58b3-45f3-96ca-8595383636d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/983df83a-58b3-45f3-96ca-8595383636d7', 'metadata': {}}])) to volume e2766fee-a890-4aac-91bb-2d6b9869d9e7. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57ec126-2c04-46d9-b070-7cf6f52029db]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6460959d-197b-48a5-ad7f-0acf5b8eb151]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:22 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_983df83a-58b3-45f3-96ca-8595383636d7_15uocg4f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:22 devstack sudo[111473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda Jun 16 09:04:22 devstack sudo[111473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:22 devstack sudo[111474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_983df83a-58b3-45f3-96ca-8595383636d7_15uocg4f Jun 16 09:04:22 devstack sudo[111474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:23 devstack sudo[111470]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5" returned: 0 in 0.865s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:23 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91550490-3de0-49e0-9850-de5908047229(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 09:04:23 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9371b6c-946c-4d32-b654-cdc1d5cf2a17]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:23 devstack sudo[111482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 Jun 16 09:04:23 devstack sudo[111482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:23 devstack sudo[111474]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_983df83a-58b3-45f3-96ca-8595383636d7_15uocg4f" returned: 0 in 0.796s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_983df83a-58b3-45f3-96ca-8595383636d7_15uocg4f {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:23 devstack sudo[111473]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda" returned: 0 in 0.921s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:23 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:23 devstack sudo[111490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba 1G Jun 16 09:04:23 devstack sudo[111490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:23 devstack sudo[111489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_983df83a-58b3-45f3-96ca-8595383636d7_15uocg4f Jun 16 09:04:23 devstack sudo[111489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:24 devstack sudo[111482]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229" returned: 0 in 0.981s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:24 devstack sudo[111501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 Jun 16 09:04:24 devstack sudo[111501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:24 devstack sudo[111489]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_983df83a-58b3-45f3-96ca-8595383636d7_15uocg4f" returned: 1 in 1.016s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_983df83a-58b3-45f3-96ca-8595383636d7_15uocg4f' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 09:04:24 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8d3680-890e-4802-b456-7b66b7f43664]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:24 devstack sudo[111490]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba 1G" returned: 0 in 0.967s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:24 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:24 devstack sudo[111506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba Jun 16 09:04:24 devstack sudo[111506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:24 devstack sudo[111505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD Jun 16 09:04:24 devstack sudo[111505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:25 devstack sudo[111501]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5" returned: 0 in 0.913s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:25 devstack sudo[111518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5 Jun 16 09:04:25 devstack sudo[111518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:25 devstack sudo[111506]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba" returned: 0 in 0.720s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:25 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba is being set with open permissions: ugo+rw Jun 16 09:04:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:25 devstack sudo[111505]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:25 devstack sudo[111521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba Jun 16 09:04:25 devstack sudo[111521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:25 devstack sudo[111522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD Jun 16 09:04:25 devstack sudo[111522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:25 devstack sudo[111518]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229.ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5" returned: 0 in 0.697s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-quobyte-ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5" released by "_delete_snapshot" :: held 3.594s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:25 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-quobyte-91550490-3de0-49e0-9850-de5908047229" released by "delete_snapshot" :: held 3.624s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:25 devstack sudo[111521]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:25 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba" returned: 0 in 0.728s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] Created reservations ['b00b1674-481f-4134-9cb8-496e28efc73f', 'b9643182-c745-42b3-af28-7e51f120ee96', '6b69ffc9-3d70-4a48-9149-f41ecb707159', 'a463f82f-c81b-4de4-be33-d2754be1faa1'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:26 devstack sudo[111522]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD" returned: 1 in 0.771s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] 983df83a-58b3-45f3-96ca-8595383636d7 was raw, converting to raw {{(pid=92348) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:26 devstack sudo[111530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.info Jun 16 09:04:26 devstack sudo[111530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:26 devstack sudo[111531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 Jun 16 09:04:26 devstack sudo[111531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:26 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] Delete snapshot completed successfully. Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-cd6c4296-fca5-4654-9e47-156f24c43938 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-ca1357f4-e2ef-4ef7-8272-12b6ef9db0a5-delete_snapshot" released by "delete_snapshot" :: held 3.847s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] Acquiring lock "cinder-91550490-3de0-49e0-9850-de5908047229-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-91550490-3de0-49e0-9850-de5908047229-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] Acquiring lock "cinder-quobyte-91550490-3de0-49e0-9850-de5908047229" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:26 devstack sudo[111530]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.info" returned: 0 in 0.689s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:26 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.info is being set with open permissions: ugo+rw Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-quobyte-91550490-3de0-49e0-9850-de5908047229" acquired by "delete_volume" :: waited 0.039s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:26 devstack sudo[111538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.info Jun 16 09:04:26 devstack sudo[111538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d60fb34-31ca-4b69-af1a-a309c0671521]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:26 devstack sudo[111531]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7" returned: 0 in 0.797s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_983df83a-58b3-45f3-96ca-8595383636d7_mkhwusisdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 {{(pid=92348) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 16 09:04:26 devstack cinder-volume[92348]: INFO cinder.image.image_utils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Converted 0.00 MB image at 0.00 MB/s Jun 16 09:04:26 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:26 devstack sudo[111541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 1G Jun 16 09:04:26 devstack sudo[111541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:26 devstack sudo[111540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 Jun 16 09:04:26 devstack sudo[111540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:27 devstack sudo[111538]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.info" returned: 0 in 0.757s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.913s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:27 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-c43ac4cd-78c3-489f-b476-06c971a22a7d tempest-CreateVolumesFromSnapshotTest-163426016 None] Create snapshot completed successfully Jun 16 09:04:27 devstack sudo[111540]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229" returned: 0 in 0.767s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:27 devstack sudo[111541]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:27 devstack sudo[111551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229 Jun 16 09:04:27 devstack sudo[111551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 1G" returned: 0 in 0.748s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:27 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5678d6b6-7352-404e-b80a-af3182ac65b2]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:27 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:27 devstack sudo[111553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 Jun 16 09:04:27 devstack sudo[111553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Flow 'volume_create_manager' (1ccf51a1-9f98-4491-8fe9-5677a004e7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7be558-18f4-472f-882a-ee5707bb1853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:28 devstack sudo[111551]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7be558-18f4-472f-882a-ee5707bb1853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-449189378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1156d5b8-879f-4aff-ae43-3ecf74d4b3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627a90d313da467384122b883f55ab2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:28Z,use_quota=True,user_id='a8c434b58c9e40119663d5d187c3e932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a030af-2fa4-4235-aa53-6f506fcd40aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a030af-2fa4-4235-aa53-6f506fcd40aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ae9bb8-dbdb-4cc4-b443-98a78ece2a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ae9bb8-dbdb-4cc4-b443-98a78ece2a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1156d5b8-879f-4aff-ae43-3ecf74d4b3a3', 'volume_name': 'volume-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a16c32-1064-4e36-a6e3-24056015832a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a16c32-1064-4e36-a6e3-24056015832a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a53df48-a63d-48e9-8f0e-666e76c95316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:28 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume 1156d5b8-879f-4aff-ae43-3ecf74d4b3a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3', 'volume_size': 1} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-449189378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1156d5b8-879f-4aff-ae43-3ecf74d4b3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627a90d313da467384122b883f55ab2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:28Z,use_quota=True,user_id='a8c434b58c9e40119663d5d187c3e932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Creating volume 1156d5b8-879f-4aff-ae43-3ecf74d4b3a3 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:04:28 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:28 devstack sudo[111553]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-91550490-3de0-49e0-9850-de5908047229" returned: 0 in 0.795s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:28 devstack sudo[111558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3 1073741824 Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7" returned: 0 in 0.746s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:28 devstack sudo[111558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-quobyte-91550490-3de0-49e0-9850-de5908047229" released by "delete_volume" :: held 1.664s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] Created reservations ['bb73ccc4-927b-48a8-b5e1-543da909b2a2', 'a9d07b35-8fe4-4e14-af43-672be1a289ff', '273f9a1f-c5ba-49e3-ad11-99a0e0289460', '4ccb5f03-97bd-420e-86ed-32a5a85b7564'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:28 devstack sudo[111560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 Jun 16 09:04:28 devstack sudo[111560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:28 devstack sudo[111562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:04:28 devstack sudo[111562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Flow 'volume_create_manager' (f169ba95-1b88-4619-bef7-12707ef1e2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b369390-a032-49dc-9284-005f0ba880d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b369390-a032-49dc-9284-005f0ba880d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-375089747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ac88ec-40e6-4957-8131-413af9a25dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627a90d313da467384122b883f55ab2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:29Z,use_quota=True,user_id='a8c434b58c9e40119663d5d187c3e932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109ab254-6b68-4c3d-aca7-865d55fdebfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109ab254-6b68-4c3d-aca7-865d55fdebfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeba29d1-af1f-40b9-a236-64d4fd2e930a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeba29d1-af1f-40b9-a236-64d4fd2e930a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ac88ec-40e6-4957-8131-413af9a25dfa', 'volume_name': 'volume-94ac88ec-40e6-4957-8131-413af9a25dfa', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dee6b76-4c0d-49c5-818e-af459f8785ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:28 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dee6b76-4c0d-49c5-818e-af459f8785ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e402f8-5502-45c2-8afb-6c887ff104b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:29 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume 94ac88ec-40e6-4957-8131-413af9a25dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ac88ec-40e6-4957-8131-413af9a25dfa', 'volume_size': 1} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] Acquiring lock "cinder-e1fd2aa0-219a-4fcb-b47a-0142972bf09d-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-e1fd2aa0-219a-4fcb-b47a-0142972bf09d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] Acquiring lock "cinder-quobyte-e1fd2aa0-219a-4fcb-b47a-0142972bf09d" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-quobyte-e1fd2aa0-219a-4fcb-b47a-0142972bf09d" acquired by "delete_volume" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab11f49d-a8f6-4468-a8b4-b9ac76a1d9bc]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:29 devstack sudo[111568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d Jun 16 09:04:29 devstack sudo[111568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:29 devstack sudo[111558]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3 1073741824" returned: 0 in 1.084s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:29 devstack sudo[111576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3 Jun 16 09:04:29 devstack sudo[111576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:29 devstack sudo[111560]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7" returned: 1 in 1.181s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Downloaded image 983df83a-58b3-45f3-96ca-8595383636d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/983df83a-58b3-45f3-96ca-8595383636d7', 'metadata': {}}])) to volume e2766fee-a890-4aac-91bb-2d6b9869d9e7 successfully. {{(pid=92348) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.image.image_utils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Temporary image 983df83a-58b3-45f3-96ca-8595383636d7 for user 8d10bcb9af21465c8768dbf83ee45229 is deleted. {{(pid=92348) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.volume_utils [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Marking volume e2766fee-a890-4aac-91bb-2d6b9869d9e7 as bootable. {{(pid=92348) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Copying metadata from image 983df83a-58b3-45f3-96ca-8595383636d7 to e2766fee-a890-4aac-91bb-2d6b9869d9e7. {{(pid=92348) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Creating volume glance metadata for volume e2766fee-a890-4aac-91bb-2d6b9869d9e7 backed by image 983df83a-58b3-45f3-96ca-8595383636d7 with: {'image_id': '983df83a-58b3-45f3-96ca-8595383636d7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ca67673d41df05eaabde0e34021ae5a1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92348) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Flow 'volume_create_manager' (291b8486-2091-4b29-ad0c-2b296f174fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a0fa16-62a1-47a5-9139-bf92325b7a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a0fa16-62a1-47a5-9139-bf92325b7a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-235333746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53663c10-239f-4f43-bcd8-2881e9640039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627a90d313da467384122b883f55ab2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:30Z,use_quota=True,user_id='a8c434b58c9e40119663d5d187c3e932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:29 devstack sudo[111562]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eafd0d13-f921-479c-9380-890f4a703e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eafd0d13-f921-479c-9380-890f4a703e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aece9f62-59b0-48a5-b82f-bf8c4ea3f981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aece9f62-59b0-48a5-b82f-bf8c4ea3f981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53663c10-239f-4f43-bcd8-2881e9640039', 'volume_name': 'volume-53663c10-239f-4f43-bcd8-2881e9640039', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1bc3151-be52-4576-a488-316565182ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1bc3151-be52-4576-a488-316565182ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4caab8ff-aeb5-436f-855e-d82c0de54c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:29 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume 53663c10-239f-4f43-bcd8-2881e9640039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53663c10-239f-4f43-bcd8-2881e9640039', 'volume_size': 1} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 1.165s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:04:29 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] Deleted volume successfully. Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b7dc6ac5-1717-4f88-a5f5-5b6d4cc223e8 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-91550490-3de0-49e0-9850-de5908047229-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c659caf-f5a8-4031-936a-2e83e45e05e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7', 'volume_size': 1, 'image_id': '983df83a-58b3-45f3-96ca-8595383636d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/983df83a-58b3-45f3-96ca-8595383636d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ca67673d41df05eaabde0e34021ae5a1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23cc46dc91be4e3dbaeb5bb2398c9b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05bec5ca9b32206bfb786363a1dabc0ebd38ceac180a84bdb52bc1ec5799358f179c8d7258db35b160b91cb1d7587b90bcd0107dfdd0ebb0285b1606b3a6b950', 'id': '983df83a-58b3-45f3-96ca-8595383636d7', 'created_at': datetime.datetime(2026, 6, 16, 7, 4, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 16, 7, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/983df83a-58b3-45f3-96ca-8595383636d7/file', 'properties': {}}, 'image_service': }' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f017b7d-56a6-4d34-b815-0d870feed019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:29 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Volume volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 (e2766fee-a890-4aac-91bb-2d6b9869d9e7): created successfully Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f017b7d-56a6-4d34-b815-0d870feed019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:29 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Flow 'volume_create_manager' (800b5b38-d24e-40fd-89ab-4951011639ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:30 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-b8c0d4f0-91d1-4300-a68b-8e5c66d1efd2 tempest-VolumeImageDependencyTests-687627649 None] Created volume successfully. Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Flow 'volume_create_manager' (f4896c60-b2e3-49c5-b915-2e886ecd43c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd48a976-1714-4ea9-8813-ef428e606eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd48a976-1714-4ea9-8813-ef428e606eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-832949368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9d7e8a-b5da-4962-a0a3-05f033e70f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627a90d313da467384122b883f55ab2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:30Z,use_quota=True,user_id='a8c434b58c9e40119663d5d187c3e932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa93ce47-bbd6-4985-aff2-03d56a8a1b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa93ce47-bbd6-4985-aff2-03d56a8a1b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5076ad3a-26dc-405b-bfd9-418c2a02690e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5076ad3a-26dc-405b-bfd9-418c2a02690e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9d7e8a-b5da-4962-a0a3-05f033e70f01', 'volume_name': 'volume-7f9d7e8a-b5da-4962-a0a3-05f033e70f01', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe9e794-ecc7-47a6-a5db-bfb23ba46114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe9e794-ecc7-47a6-a5db-bfb23ba46114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86df2e7b-a6a0-4770-bb12-7aeb694178a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:30 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume 7f9d7e8a-b5da-4962-a0a3-05f033e70f01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9d7e8a-b5da-4962-a0a3-05f033e70f01', 'volume_size': 1} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:30 devstack sudo[111576]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3" returned: 0 in 0.782s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:30 devstack sudo[111582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:04:30 devstack sudo[111582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.292s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-375089747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ac88ec-40e6-4957-8131-413af9a25dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627a90d313da467384122b883f55ab2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:29Z,use_quota=True,user_id='a8c434b58c9e40119663d5d187c3e932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Creating volume 94ac88ec-40e6-4957-8131-413af9a25dfa {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:04:30 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-94ac88ec-40e6-4957-8131-413af9a25dfa 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a53df48-a63d-48e9-8f0e-666e76c95316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac90db1-6f40-4f05-a141-5dc53e2bc0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:30 devstack sudo[111584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-94ac88ec-40e6-4957-8131-413af9a25dfa 1073741824 Jun 16 09:04:30 devstack sudo[111584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:30 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume volume-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3 (1156d5b8-879f-4aff-ae43-3ecf74d4b3a3): created successfully Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac90db1-6f40-4f05-a141-5dc53e2bc0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:30 devstack sudo[111568]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Flow 'volume_create_manager' (1ccf51a1-9f98-4491-8fe9-5677a004e7b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d" returned: 0 in 1.284s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:30 devstack sudo[111586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d Jun 16 09:04:30 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-821129c9-3ff1-4b50-8160-6f75e4bcea60 tempest-CreateVolumesFromSnapshotTest-163426016 None] Created volume successfully. Jun 16 09:04:30 devstack sudo[111586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Flow 'volume_create_manager' (57391bd5-3062-4825-beaa-6846b0233047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989274ed-5b1c-4525-98ce-bd51bee5a7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989274ed-5b1c-4525-98ce-bd51bee5a7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-514685288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627a90d313da467384122b883f55ab2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:30Z,use_quota=True,user_id='a8c434b58c9e40119663d5d187c3e932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9996ef42-f57f-4c36-a6c8-a8874ecd7fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9996ef42-f57f-4c36-a6c8-a8874ecd7fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89852578-ab97-4f34-8524-fe0dc97f41ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89852578-ab97-4f34-8524-fe0dc97f41ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf', 'volume_name': 'volume-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb32799-42a1-4b94-8b88-debdb96ae876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb32799-42a1-4b94-8b88-debdb96ae876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8d9d94-5c9d-4c09-aa5f-7f5529eec9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:30 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume 6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf', 'volume_size': 1} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Acquiring lock "cinder-e2766fee-a890-4aac-91bb-2d6b9869d9e7-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Lock "cinder-e2766fee-a890-4aac-91bb-2d6b9869d9e7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Acquiring lock "cinder-quobyte-e2766fee-a890-4aac-91bb-2d6b9869d9e7" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Lock "cinder-quobyte-e2766fee-a890-4aac-91bb-2d6b9869d9e7" acquired by "delete_volume" :: waited 0.023s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:30 devstack sudo[111582]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.729s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_service.periodic_task [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] Running periodic task VolumeManager._thread_info {{(pid=92348) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread count: 28 {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-923d638f-081f-4d21-bbb7-7cc42f7fef65 None None] thread info: [<_MainThread(MainThread, started 127169232593024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92348) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[c226e97f-1adc-4955-9cbc-4a5108d23e91]: (4, 'raw') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:30 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:31 devstack sudo[111591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 Jun 16 09:04:31 devstack sudo[111591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:31 devstack sudo[111586]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e1fd2aa0-219a-4fcb-b47a-0142972bf09d" returned: 0 in 0.707s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:31 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-quobyte-e1fd2aa0-219a-4fcb-b47a-0142972bf09d" released by "delete_volume" :: held 2.063s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:31 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] Created reservations ['009cbf2a-329d-410b-9d08-933b9bb084a2', 'a3d93446-479c-4d0f-a983-120052cd99d2', 'c1c34108-8df5-42e7-bbeb-7ec5557b82bd', '44b54a42-4e36-41b3-bc7b-a04e96987aa5'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:31 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:31 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:31 devstack sudo[111584]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:31 devstack sudo[111595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:04:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-94ac88ec-40e6-4957-8131-413af9a25dfa 1073741824" returned: 0 in 0.984s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:31 devstack sudo[111595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-94ac88ec-40e6-4957-8131-413af9a25dfa {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:31 devstack sudo[111597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-94ac88ec-40e6-4957-8131-413af9a25dfa Jun 16 09:04:31 devstack sudo[111597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:31 devstack sudo[111591]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7" returned: 0 in 0.748s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:31 devstack sudo[111601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 Jun 16 09:04:31 devstack sudo[111601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:31 devstack sudo[111595]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:31 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.631s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:31 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:04:31 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] Deleted volume successfully. Jun 16 09:04:31 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-f6f1f32b-fc7e-4dc4-91f6-b6a073e642e5 tempest-VolumeDependencyTests-137865675 None] Lock "cinder-e1fd2aa0-219a-4fcb-b47a-0142972bf09d-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:32 devstack sudo[111597]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-94ac88ec-40e6-4957-8131-413af9a25dfa" returned: 0 in 0.653s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.231s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-235333746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53663c10-239f-4f43-bcd8-2881e9640039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627a90d313da467384122b883f55ab2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:30Z,use_quota=True,user_id='a8c434b58c9e40119663d5d187c3e932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Creating volume 53663c10-239f-4f43-bcd8-2881e9640039 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:04:32 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53663c10-239f-4f43-bcd8-2881e9640039 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:32 devstack sudo[111605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53663c10-239f-4f43-bcd8-2881e9640039 1073741824 Jun 16 09:04:32 devstack sudo[111605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e402f8-5502-45c2-8afb-6c887ff104b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ac88ec-40e6-4957-8131-413af9a25dfa', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde043d7-ae09-47cb-a6dc-144e2d0cf377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:32 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume volume-94ac88ec-40e6-4957-8131-413af9a25dfa (94ac88ec-40e6-4957-8131-413af9a25dfa): created successfully Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde043d7-ae09-47cb-a6dc-144e2d0cf377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Flow 'volume_create_manager' (f169ba95-1b88-4619-bef7-12707ef1e2fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:32 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-db6fc778-99cd-4226-a658-dd02b264ad55 tempest-CreateVolumesFromSnapshotTest-163426016 None] Created volume successfully. Jun 16 09:04:32 devstack sudo[111601]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7" returned: 1 in 0.682s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7' failed. Not Retrying. {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:32 devstack sudo[111612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7 Jun 16 09:04:32 devstack sudo[111612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:32 devstack sudo[111605]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53663c10-239f-4f43-bcd8-2881e9640039 1073741824" returned: 0 in 0.841s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:32 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53663c10-239f-4f43-bcd8-2881e9640039 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:32 devstack sudo[111618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53663c10-239f-4f43-bcd8-2881e9640039 Jun 16 09:04:32 devstack sudo[111618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:33 devstack sudo[111612]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-e2766fee-a890-4aac-91bb-2d6b9869d9e7" returned: 0 in 0.669s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Lock "cinder-quobyte-e2766fee-a890-4aac-91bb-2d6b9869d9e7" released by "delete_volume" :: held 2.177s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Created reservations ['7cae9138-9883-434a-b351-8312d9844e40', '61ac03de-8c87-4004-91d6-9787e4620cb9', '664142a7-1616-495f-aed5-27bbd314b04f', 'b52afa5d-eabc-42c6-86d2-77e663e67811'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:33 devstack sudo[111621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:04:33 devstack sudo[111621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:33 devstack sudo[111618]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53663c10-239f-4f43-bcd8-2881e9640039" returned: 0 in 0.640s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.389s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-832949368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9d7e8a-b5da-4962-a0a3-05f033e70f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627a90d313da467384122b883f55ab2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:30Z,use_quota=True,user_id='a8c434b58c9e40119663d5d187c3e932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Creating volume 7f9d7e8a-b5da-4962-a0a3-05f033e70f01 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:04:33 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7f9d7e8a-b5da-4962-a0a3-05f033e70f01 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:33 devstack sudo[111624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7f9d7e8a-b5da-4962-a0a3-05f033e70f01 1073741824 Jun 16 09:04:33 devstack sudo[111624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4caab8ff-aeb5-436f-855e-d82c0de54c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53663c10-239f-4f43-bcd8-2881e9640039', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b930b565-56df-4fa4-a165-34385d0371a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:33 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume volume-53663c10-239f-4f43-bcd8-2881e9640039 (53663c10-239f-4f43-bcd8-2881e9640039): created successfully Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b930b565-56df-4fa4-a165-34385d0371a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Flow 'volume_create_manager' (291b8486-2091-4b29-ad0c-2b296f174fa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:33 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-663d38cb-77a2-4135-bcf3-8fddfa0c5964 tempest-CreateVolumesFromSnapshotTest-163426016 None] Created volume successfully. Jun 16 09:04:33 devstack sudo[111621]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.680s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:04:33 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Deleted volume successfully. Jun 16 09:04:33 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4755ea29-93dd-4805-a5c3-5a8f850b6447 tempest-VolumeImageDependencyTests-687627649 None] Lock "cinder-e2766fee-a890-4aac-91bb-2d6b9869d9e7-delete_volume" released by "delete_volume" :: held 3.085s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:34 devstack sudo[111624]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7f9d7e8a-b5da-4962-a0a3-05f033e70f01 1073741824" returned: 0 in 0.889s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:34 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7f9d7e8a-b5da-4962-a0a3-05f033e70f01 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:34 devstack sudo[111631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7f9d7e8a-b5da-4962-a0a3-05f033e70f01 Jun 16 09:04:34 devstack sudo[111631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:35 devstack sudo[111631]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7f9d7e8a-b5da-4962-a0a3-05f033e70f01" returned: 0 in 0.611s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:04:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.561s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-514685288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627a90d313da467384122b883f55ab2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:30Z,use_quota=True,user_id='a8c434b58c9e40119663d5d187c3e932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:04:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Creating volume 6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:04:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:35 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:04:35 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:04:35 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86df2e7b-a6a0-4770-bb12-7aeb694178a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9d7e8a-b5da-4962-a0a3-05f033e70f01', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:35 devstack sudo[111634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf 1073741824 Jun 16 09:04:35 devstack sudo[111634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498cb8e2-72f8-42ba-a787-818119f443a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:35 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume volume-7f9d7e8a-b5da-4962-a0a3-05f033e70f01 (7f9d7e8a-b5da-4962-a0a3-05f033e70f01): created successfully Jun 16 09:04:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498cb8e2-72f8-42ba-a787-818119f443a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:35 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Flow 'volume_create_manager' (f4896c60-b2e3-49c5-b915-2e886ecd43c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:35 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-f03976a4-4723-4696-9c01-851d0f263521 tempest-CreateVolumesFromSnapshotTest-163426016 None] Created volume successfully. Jun 16 09:04:36 devstack sudo[111634]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf 1073741824" returned: 0 in 0.870s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:36 devstack sudo[111641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf Jun 16 09:04:36 devstack sudo[111641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:36 devstack sudo[111641]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf" returned: 0 in 0.600s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:36 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:04:36 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8d9d94-5c9d-4c09-aa5f-7f5529eec9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e882a7c2-19cb-4b60-acd3-57617b7c5083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:36 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Volume volume-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf (6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf): created successfully Jun 16 09:04:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e882a7c2-19cb-4b60-acd3-57617b7c5083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:36 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Flow 'volume_create_manager' (57391bd5-3062-4825-beaa-6846b0233047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:36 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-703e6ce1-46c2-490c-92c1-2a9870247e70 tempest-CreateVolumesFromSnapshotTest-163426016 None] Created volume successfully. Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Flow 'volume_create_manager' (bbbab14e-0336-49a9-aa57-94f86bb2958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e4ace7-d5b7-4556-8e41-0cba1533cbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "cinder-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e4ace7-d5b7-4556-8e41-0cba1533cbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a44d8d-e03a-40e6-a612-e4b1662bcc38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='342d8be98a054c78b6c42bf00f2c4499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:37Z,use_quota=True,user_id='f706d49321cc4a80af14b52b8f0aa221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d949efb-c484-486d-988c-b4dea2efe1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d949efb-c484-486d-988c-b4dea2efe1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8462ad-016e-4528-8def-13c32cac314f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8462ad-016e-4528-8def-13c32cac314f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0a44d8d-e03a-40e6-a612-e4b1662bcc38', 'volume_name': 'volume-d0a44d8d-e03a-40e6-a612-e4b1662bcc38', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998c0eae-e4d7-40b7-a1ed-7d8a189db5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998c0eae-e4d7-40b7-a1ed-7d8a189db5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f1190d-4e6f-429c-a055-98eb453957f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:37 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Volume d0a44d8d-e03a-40e6-a612-e4b1662bcc38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0a44d8d-e03a-40e6-a612-e4b1662bcc38', 'volume_size': 1} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a44d8d-e03a-40e6-a612-e4b1662bcc38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='342d8be98a054c78b6c42bf00f2c4499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:37Z,use_quota=True,user_id='f706d49321cc4a80af14b52b8f0aa221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Creating volume d0a44d8d-e03a-40e6-a612-e4b1662bcc38 {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:04:37 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d0a44d8d-e03a-40e6-a612-e4b1662bcc38 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:37 devstack sudo[111644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d0a44d8d-e03a-40e6-a612-e4b1662bcc38 1073741824 Jun 16 09:04:37 devstack sudo[111644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "cinder-quobyte-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-quobyte-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[7611180a-8fc8-4103-8b90-c3e8d6499667]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:37 devstack sudo[111646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf Jun 16 09:04:37 devstack sudo[111646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:37 devstack sudo[111644]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:37 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d0a44d8d-e03a-40e6-a612-e4b1662bcc38 1073741824" returned: 0 in 0.785s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d0a44d8d-e03a-40e6-a612-e4b1662bcc38 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:38 devstack sudo[111646]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf" returned: 0 in 0.739s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:38 devstack sudo[111654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d0a44d8d-e03a-40e6-a612-e4b1662bcc38 Jun 16 09:04:38 devstack sudo[111654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:38 devstack sudo[111655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf Jun 16 09:04:38 devstack sudo[111655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:38 devstack sudo[111654]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d0a44d8d-e03a-40e6-a612-e4b1662bcc38" returned: 0 in 0.617s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:38 devstack sudo[111655]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf" returned: 0 in 0.608s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-quobyte-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf" released by "delete_volume" :: held 1.390s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f1190d-4e6f-429c-a055-98eb453957f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a44d8d-e03a-40e6-a612-e4b1662bcc38', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c275f351-92d7-41b9-a1ba-1d74424a2244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:38 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Volume volume-d0a44d8d-e03a-40e6-a612-e4b1662bcc38 (d0a44d8d-e03a-40e6-a612-e4b1662bcc38): created successfully Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c275f351-92d7-41b9-a1ba-1d74424a2244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Flow 'volume_create_manager' (bbbab14e-0336-49a9-aa57-94f86bb2958a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:38 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-80af28f6-066f-41f9-9b4b-04308f8438af tempest-CinderUnicodeTest-697625162 None] Created volume successfully. Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] Created reservations ['8f2f9b5f-c3c8-46e9-9dbc-ac8a0888bcc3', '7a3d0749-683e-4130-bb61-8168713333c9', '0cad81d7-31da-4517-8cd1-f1eeca29971f', 'e1246cee-f141-4fa5-86f2-9360cc394133'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:38 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:38 devstack sudo[111661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:04:38 devstack sudo[111661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "cinder-7f9d7e8a-b5da-4962-a0a3-05f033e70f01-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-7f9d7e8a-b5da-4962-a0a3-05f033e70f01-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "cinder-quobyte-7f9d7e8a-b5da-4962-a0a3-05f033e70f01" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-quobyte-7f9d7e8a-b5da-4962-a0a3-05f033e70f01" acquired by "delete_volume" :: waited 0.017s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:39 devstack sudo[111661]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.628s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:04:39 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] Deleted volume successfully. Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97fe58c-996e-4b76-9f87-08bbf7c3fe29]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7f9d7e8a-b5da-4962-a0a3-05f033e70f01 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-08b6afce-93c1-4973-b20b-a5c8222a9014 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-6e7ce16a-3528-4b85-ab8e-8b068dd4b3bf-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:39 devstack sudo[111664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7f9d7e8a-b5da-4962-a0a3-05f033e70f01 Jun 16 09:04:39 devstack sudo[111664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92348) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Flow 'volume_create_manager' (adac7140-0ba1-45f8-94ae-78fc19738bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e8cc06-311b-46d1-a841-2803f032e162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e8cc06-311b-46d1-a841-2803f032e162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-161809793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c060b550-64bd-4d21-8366-0216dd90e55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='342d8be98a054c78b6c42bf00f2c4499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:40Z,use_quota=True,user_id='f706d49321cc4a80af14b52b8f0aa221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c045eac0-c4a0-44f7-99a4-5d9edd5fdf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c045eac0-c4a0-44f7-99a4-5d9edd5fdf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffce8d5-1c65-47d3-83ca-5496dfa843f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffce8d5-1c65-47d3-83ca-5496dfa843f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c060b550-64bd-4d21-8366-0216dd90e55c', 'volume_name': 'volume-c060b550-64bd-4d21-8366-0216dd90e55c', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81b03d5-5a73-40ff-9811-75fa60b54558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81b03d5-5a73-40ff-9811-75fa60b54558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c79e78ca-11e3-4ed2-bc51-6c98e9fe75da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:39 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Volume c060b550-64bd-4d21-8366-0216dd90e55c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c060b550-64bd-4d21-8366-0216dd90e55c', 'volume_size': 1} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-16T07:04:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-161809793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c060b550-64bd-4d21-8366-0216dd90e55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='342d8be98a054c78b6c42bf00f2c4499',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-16T07:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-16T07:04:40Z,use_quota=True,user_id='f706d49321cc4a80af14b52b8f0aa221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543539b7-c88a-4143-a158-c03568914fc2),volume_type_id=543539b7-c88a-4143-a158-c03568914fc2)}" {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Creating volume c060b550-64bd-4d21-8366-0216dd90e55c {{(pid=92348) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Selected osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 as target Quobyte volume. {{(pid=92348) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 16 09:04:39 devstack cinder-volume[92348]: INFO cinder.volume.drivers.remotefs [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] casted to osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6 Jun 16 09:04:39 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c 1073741824 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:39 devstack sudo[111666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c 1073741824 Jun 16 09:04:39 devstack sudo[111666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:40 devstack sudo[111664]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7f9d7e8a-b5da-4962-a0a3-05f033e70f01" returned: 0 in 0.726s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7f9d7e8a-b5da-4962-a0a3-05f033e70f01 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:40 devstack sudo[111671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7f9d7e8a-b5da-4962-a0a3-05f033e70f01 Jun 16 09:04:40 devstack sudo[111671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:40 devstack sudo[111666]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c 1073741824" returned: 0 in 0.776s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:40 devstack sudo[111676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c Jun 16 09:04:40 devstack sudo[111676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:40 devstack sudo[111671]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-7f9d7e8a-b5da-4962-a0a3-05f033e70f01" returned: 0 in 0.646s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:40 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-quobyte-7f9d7e8a-b5da-4962-a0a3-05f033e70f01" released by "delete_volume" :: held 1.425s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:40 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] Created reservations ['134297ea-e21a-4874-b35a-bd31a0551d8b', 'a66d753f-e7de-48d7-b5bf-605b199766ea', '60b7de02-bfae-4a1a-b205-6e85802ed4a1', '2ae05376-d260-4604-ac37-d1c4689a8c4f'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:40 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:40 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:41 devstack sudo[111679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:04:41 devstack sudo[111679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:41 devstack sudo[111676]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c" returned: 0 in 0.587s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:41 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'} {{(pid=92348) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 16 09:04:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c79e78ca-11e3-4ed2-bc51-6c98e9fe75da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c060b550-64bd-4d21-8366-0216dd90e55c', 'volume_size': 1}' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec008d6-ea9f-4da2-86f1-cab525462f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 16 09:04:41 devstack cinder-volume[92348]: INFO cinder.volume.flows.manager.create_volume [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Volume volume-c060b550-64bd-4d21-8366-0216dd90e55c (c060b550-64bd-4d21-8366-0216dd90e55c): created successfully Jun 16 09:04:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec008d6-ea9f-4da2-86f1-cab525462f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92348) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 16 09:04:41 devstack cinder-volume[92348]: DEBUG cinder.volume.manager [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Flow 'volume_create_manager' (adac7140-0ba1-45f8-94ae-78fc19738bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92348) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 16 09:04:41 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-8b1b6540-af99-422a-9f0a-bd031cd484c8 tempest-CinderUnicodeTest-697625162 None] Created volume successfully. Jun 16 09:04:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "cinder-53663c10-239f-4f43-bcd8-2881e9640039-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:41 devstack sudo[111679]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-53663c10-239f-4f43-bcd8-2881e9640039-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.610s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:41 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:04:41 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] Deleted volume successfully. Jun 16 09:04:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-e20c3760-eaaf-497e-8ae3-4a766690caba tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-7f9d7e8a-b5da-4962-a0a3-05f033e70f01-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "cinder-quobyte-53663c10-239f-4f43-bcd8-2881e9640039" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:41 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-quobyte-53663c10-239f-4f43-bcd8-2881e9640039" acquired by "delete_volume" :: waited 0.013s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:41 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d26370-c2fb-4792-ae44-dd1798d3582e]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:41 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53663c10-239f-4f43-bcd8-2881e9640039 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:41 devstack sudo[111683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53663c10-239f-4f43-bcd8-2881e9640039 Jun 16 09:04:41 devstack sudo[111683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:42 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] Creating offline snapshot 59ab1091-7e90-447a-9e36-5323d89168e0 of volume c060b550-64bd-4d21-8366-0216dd90e55c {{(pid=92348) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 16 09:04:42 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[631913fb-14f5-4d68-bd73-8f458e587e91]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:42 devstack sudo[111685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c Jun 16 09:04:42 devstack sudo[111685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:42 devstack sudo[111683]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53663c10-239f-4f43-bcd8-2881e9640039" returned: 0 in 0.712s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53663c10-239f-4f43-bcd8-2881e9640039 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:42 devstack sudo[111690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53663c10-239f-4f43-bcd8-2881e9640039 Jun 16 09:04:42 devstack sudo[111690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:42 devstack sudo[111685]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c" returned: 0 in 0.717s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0 1G {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:42 devstack sudo[111695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0 1G Jun 16 09:04:42 devstack sudo[111695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:42 devstack sudo[111690]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:42 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-53663c10-239f-4f43-bcd8-2881e9640039" returned: 0 in 0.599s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-quobyte-53663c10-239f-4f43-bcd8-2881e9640039" released by "delete_volume" :: held 1.352s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] Created reservations ['dd920afc-a682-4a63-909e-a6fcad1caec9', '35d8d677-5f98-41ad-b46a-d638a608e0a9', '17ad2367-914d-4174-bdb7-dfb1081d2ae3', 'c263ce06-31eb-44cf-9af1-a2ea74ce0862'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:43 devstack sudo[111698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:04:43 devstack sudo[111698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:43 devstack sudo[111695]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0 1G" returned: 0 in 0.723s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c060b550-64bd-4d21-8366-0216dd90e55c -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:43 devstack sudo[111703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c060b550-64bd-4d21-8366-0216dd90e55c -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0 Jun 16 09:04:43 devstack sudo[111703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:43 devstack sudo[111698]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.602s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:04:43 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] Deleted volume successfully. Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-4325ec23-801b-440e-a3af-300d8066ccbc tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-53663c10-239f-4f43-bcd8-2881e9640039-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "cinder-94ac88ec-40e6-4957-8131-413af9a25dfa-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-94ac88ec-40e6-4957-8131-413af9a25dfa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "cinder-quobyte-94ac88ec-40e6-4957-8131-413af9a25dfa" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-quobyte-94ac88ec-40e6-4957-8131-413af9a25dfa" acquired by "delete_volume" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[912326bd-0503-4682-b71e-df72e86e8089]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:43 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-94ac88ec-40e6-4957-8131-413af9a25dfa {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:43 devstack sudo[111706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-94ac88ec-40e6-4957-8131-413af9a25dfa Jun 16 09:04:43 devstack sudo[111706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:44 devstack sudo[111703]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c060b550-64bd-4d21-8366-0216dd90e55c -F qcow2 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0" returned: 0 in 0.673s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:44 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0 is being set with open permissions: ugo+rw Jun 16 09:04:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:44 devstack sudo[111711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0 Jun 16 09:04:44 devstack sudo[111711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:44 devstack sudo[111706]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-94ac88ec-40e6-4957-8131-413af9a25dfa" returned: 0 in 0.751s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-94ac88ec-40e6-4957-8131-413af9a25dfa {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:44 devstack sudo[111716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-94ac88ec-40e6-4957-8131-413af9a25dfa Jun 16 09:04:44 devstack sudo[111716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:44 devstack sudo[111711]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0" returned: 0 in 0.601s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:44 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:44 devstack sudo[111719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.info Jun 16 09:04:44 devstack sudo[111719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:45 devstack sudo[111716]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-94ac88ec-40e6-4957-8131-413af9a25dfa" returned: 0 in 0.604s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:45 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-quobyte-94ac88ec-40e6-4957-8131-413af9a25dfa" released by "delete_volume" :: held 1.398s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:45 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] Created reservations ['0c26310d-f22f-4521-8850-e76ffc08f147', 'e8ac6ce3-92ec-4b45-a72e-f1d0f0a59334', '913006fd-f9eb-4a17-8159-4936b0dda216', 'f988acf1-9fe6-42f8-8ea2-5859badb3cbd'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:45 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:45 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:45 devstack sudo[111723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:04:45 devstack sudo[111723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:45 devstack sudo[111719]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.info" returned: 0 in 0.622s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:45 devstack cinder-volume[92348]: WARNING cinder.volume.drivers.remotefs [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.info is being set with open permissions: ugo+rw Jun 16 09:04:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.info {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:45 devstack sudo[111725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.info Jun 16 09:04:45 devstack sudo[111725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:45 devstack sudo[111723]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:45 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.600s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:45 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:04:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "cinder-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:46 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] Deleted volume successfully. Jun 16 09:04:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-6b57ceaa-362a-4434-8e76-3bbab75a5fa6 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-94ac88ec-40e6-4957-8131-413af9a25dfa-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:46 devstack sudo[111725]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.info" returned: 0 in 0.612s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.039s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "cinder-quobyte-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:46 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-quobyte-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3" acquired by "delete_volume" :: waited 0.024s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:46 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-e7d826d6-ae84-4533-96c3-9d2109bccabb tempest-CinderUnicodeTest-697625162 None] Create snapshot completed successfully Jun 16 09:04:46 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9db511c-7724-4aad-b8a3-c69cb0e97cac]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:46 devstack sudo[111729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3 Jun 16 09:04:46 devstack sudo[111729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:46 devstack sudo[111729]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3" returned: 0 in 0.706s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:46 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:46 devstack sudo[111734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3 Jun 16 09:04:46 devstack sudo[111734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] Acquiring lock "cinder-59ab1091-7e90-447a-9e36-5323d89168e0-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] Lock "cinder-59ab1091-7e90-447a-9e36-5323d89168e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] Acquiring lock "cinder-quobyte-c060b550-64bd-4d21-8366-0216dd90e55c" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] Lock "cinder-quobyte-c060b550-64bd-4d21-8366-0216dd90e55c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] Acquiring lock "cinder-quobyte-59ab1091-7e90-447a-9e36-5323d89168e0" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] Lock "cinder-quobyte-59ab1091-7e90-447a-9e36-5323d89168e0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] Deleting offline snapshot 59ab1091-7e90-447a-9e36-5323d89168e0 of volume c060b550-64bd-4d21-8366-0216dd90e55c {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] snapshot_file for this snap is: volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0 {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cad924-4cd3-43fa-a42d-1b017918331d]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:47 devstack sudo[111736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0 Jun 16 09:04:47 devstack sudo[111736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:47 devstack sudo[111734]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3" returned: 0 in 0.616s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-quobyte-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3" released by "delete_volume" :: held 1.366s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] Created reservations ['f12a7b96-725c-4e08-939c-8cb1c1daf285', 'b363d0c2-c9c3-4363-9944-6cbabff25c8a', '077f79b6-0669-478f-9765-8a304172310b', '51701480-2cdf-4c4a-ab2e-89a6817099a2'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:47 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:47 devstack sudo[111739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:04:47 devstack sudo[111739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:48 devstack sudo[111736]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0" returned: 0 in 0.741s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c060b550-64bd-4d21-8366-0216dd90e55c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd4ab8b-0bdf-4af9-9470-ed99e52d57d9]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "cinder-0328a27b-f1d5-471c-a8fd-59b6e0edc2ba-delete_snapshot" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:48 devstack sudo[111739]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.622s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:48 devstack sudo[111745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c Jun 16 09:04:48 devstack sudo[111745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-0328a27b-f1d5-471c-a8fd-59b6e0edc2ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "cinder-quobyte-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda" by "delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:48 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] Deleted volume successfully. Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-quobyte-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "cinder-quobyte-0328a27b-f1d5-471c-a8fd-59b6e0edc2ba" by "_delete_snapshot" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-b1d31452-b7ca-4cb7-8d3a-8f756bdfdd8c tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-1156d5b8-879f-4aff-ae43-3ecf74d4b3a3-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-quobyte-0328a27b-f1d5-471c-a8fd-59b6e0edc2ba" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] Deleting offline snapshot 0328a27b-f1d5-471c-a8fd-59b6e0edc2ba of volume d8563c81-ca4a-40ca-9e91-c9c51ffc0dda {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] snapshot_file for this snap is: volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba {{(pid=92348) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[9147fc3d-6c11-4b39-a620-ee3f1946f8ba]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:48 devstack sudo[111747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba Jun 16 09:04:48 devstack sudo[111747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:48 devstack sudo[111745]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c" returned: 0 in 0.729s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:48 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:48 devstack sudo[111753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0 Jun 16 09:04:48 devstack sudo[111753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:49 devstack sudo[111747]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba" returned: 0 in 0.714s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:49 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.remotefs [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92348) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 16 09:04:49 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e55354a-0940-494f-8b56-cd51a1bb9f3d]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:49 devstack sudo[111758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda Jun 16 09:04:49 devstack sudo[111758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:49 devstack sudo[111753]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0" returned: 0 in 0.686s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:49 devstack sudo[111763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0 Jun 16 09:04:49 devstack sudo[111763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:49 devstack sudo[111758]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda" returned: 0 in 0.726s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:49 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:49 devstack sudo[111768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba Jun 16 09:04:49 devstack sudo[111768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:50 devstack sudo[111763]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c.59ab1091-7e90-447a-9e36-5323d89168e0" returned: 0 in 0.585s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] Lock "cinder-quobyte-59ab1091-7e90-447a-9e36-5323d89168e0" released by "_delete_snapshot" :: held 2.847s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] Lock "cinder-quobyte-c060b550-64bd-4d21-8366-0216dd90e55c" released by "delete_snapshot" :: held 2.868s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:50 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] Created reservations ['dfc00a44-780b-41d1-a944-d261f4740fea', '8c911d2e-8079-4440-a1f8-bc0c6fd0f0ee', '6567f523-5ccc-407a-b058-509d171aa07d', 'cefa2d28-5f37-4786-ae3e-c121fa26e6c1'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:50 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] Delete snapshot completed successfully. Jun 16 09:04:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-5b565ae5-886c-4b52-9787-bdcf2437903b tempest-CinderUnicodeTest-697625162 None] Lock "cinder-59ab1091-7e90-447a-9e36-5323d89168e0-delete_snapshot" released by "delete_snapshot" :: held 2.995s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] Acquiring lock "cinder-c060b550-64bd-4d21-8366-0216dd90e55c-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] Lock "cinder-c060b550-64bd-4d21-8366-0216dd90e55c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:50 devstack sudo[111768]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba" returned: 0 in 0.736s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:50 devstack sudo[111774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba Jun 16 09:04:50 devstack sudo[111774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] Acquiring lock "cinder-quobyte-c060b550-64bd-4d21-8366-0216dd90e55c" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:50 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] Lock "cinder-quobyte-c060b550-64bd-4d21-8366-0216dd90e55c" acquired by "delete_volume" :: waited 0.016s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:50 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1849040-4b58-465c-a532-99fa19a0b5a2]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:50 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:50 devstack sudo[111776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c Jun 16 09:04:50 devstack sudo[111776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:51 devstack sudo[111774]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda.0328a27b-f1d5-471c-a8fd-59b6e0edc2ba" returned: 0 in 0.582s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:51 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-quobyte-0328a27b-f1d5-471c-a8fd-59b6e0edc2ba" released by "_delete_snapshot" :: held 2.861s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:51 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-quobyte-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda" released by "delete_snapshot" :: held 2.890s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:51 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] Created reservations ['ea43f678-5f41-4337-b8a7-932417d57c0e', '63e9cc75-40fc-4051-a223-9c7be68b360f', 'cc13154f-5f89-49a1-a3db-dce40c1d7182', '473089bb-f4b9-4b6e-ab48-3c6f4ba2ce00'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:51 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] Delete snapshot completed successfully. Jun 16 09:04:51 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-fa1162e3-e2b1-4267-99a2-93bdc81e2993 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-0328a27b-f1d5-471c-a8fd-59b6e0edc2ba-delete_snapshot" released by "delete_snapshot" :: held 3.029s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:51 devstack sudo[111776]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c" returned: 0 in 0.704s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:51 devstack sudo[111783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c Jun 16 09:04:51 devstack sudo[111783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:51 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "cinder-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:51 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:51 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "cinder-quobyte-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:51 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-quobyte-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda" acquired by "delete_volume" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:51 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[48811e6c-636b-44db-a29b-8e882e4c4eec]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:51 devstack sudo[111785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda Jun 16 09:04:51 devstack sudo[111785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:51 devstack sudo[111783]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:51 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-c060b550-64bd-4d21-8366-0216dd90e55c" returned: 0 in 0.600s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:51 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] Lock "cinder-quobyte-c060b550-64bd-4d21-8366-0216dd90e55c" released by "delete_volume" :: held 1.358s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:51 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] Created reservations ['ef921a61-a854-48c6-9fca-0b03ced3791b', '84b69cbe-7478-479d-a31e-e254ba679f00', '0dab8889-df47-4f16-a062-625ceaeceb54', 'b2fe755f-6ee9-4fb9-9661-37d921f47135'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:52 devstack sudo[111788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:04:52 devstack sudo[111788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:52 devstack sudo[111785]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda" returned: 0 in 0.726s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:52 devstack sudo[111793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda Jun 16 09:04:52 devstack sudo[111793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:52 devstack sudo[111788]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] Acquiring lock "cinder-d0a44d8d-e03a-40e6-a612-e4b1662bcc38-delete_volume" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.616s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:04:52 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] Deleted volume successfully. Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] Lock "cinder-d0a44d8d-e03a-40e6-a612-e4b1662bcc38-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-ef711dd3-2a7e-41e9-af0b-5dd27560db46 tempest-CinderUnicodeTest-697625162 None] Lock "cinder-c060b550-64bd-4d21-8366-0216dd90e55c-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] Acquiring lock "cinder-quobyte-d0a44d8d-e03a-40e6-a612-e4b1662bcc38" by "delete_volume" {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] Lock "cinder-quobyte-d0a44d8d-e03a-40e6-a612-e4b1662bcc38" acquired by "delete_volume" :: waited 0.015s {{(pid=92348) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d754fbf-fd54-4853-ac1b-d649975c6536]: (4, 'qcow2') {{(pid=93408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d0a44d8d-e03a-40e6-a612-e4b1662bcc38 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:52 devstack sudo[111793]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda" returned: 0 in 0.623s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:52 devstack sudo[111797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d0a44d8d-e03a-40e6-a612-e4b1662bcc38 Jun 16 09:04:52 devstack sudo[111797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-quobyte-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda" released by "delete_volume" :: held 1.404s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] Created reservations ['45634207-15f7-41a9-87f8-b4f22f6fa06b', '1b68ce8c-99d2-4c66-b736-18bd202dcc6e', '8b12b345-a867-41eb-add4-6eb29ebb8d94', '0458c659-12f5-4278-ab9a-97208e3a4835'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:52 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:53 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:53 devstack sudo[111799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:04:53 devstack sudo[111799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:53 devstack sudo[111797]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d0a44d8d-e03a-40e6-a612-e4b1662bcc38" returned: 0 in 0.707s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d0a44d8d-e03a-40e6-a612-e4b1662bcc38 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:53 devstack sudo[111805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d0a44d8d-e03a-40e6-a612-e4b1662bcc38 Jun 16 09:04:53 devstack sudo[111805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:53 devstack sudo[111799]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:53 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.578s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:53 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:04:53 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] Deleted volume successfully. Jun 16 09:04:53 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-bfb97f18-a912-4c71-8ea5-5148023807f1 tempest-CreateVolumesFromSnapshotTest-163426016 None] Lock "cinder-d8563c81-ca4a-40ca-9e91-c9c51ffc0dda-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:54 devstack sudo[111805]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619/volume-d0a44d8d-e03a-40e6-a612-e4b1662bcc38" returned: 0 in 0.593s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] Lock "cinder-quobyte-d0a44d8d-e03a-40e6-a612-e4b1662bcc38" released by "delete_volume" :: held 1.343s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:04:54 devstack cinder-volume[92348]: DEBUG cinder.quota [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] Created reservations ['a9e9ef3b-d148-42ca-bf8f-c815fbc6aa79', 'c102f066-40d7-4a6f-9fd5-89d8009e850a', 'c67eb8ac-ac05-47fc-ad0a-d2cb91350705', 'fdf05e9b-50e6-43db-bdc9-705f57cb7038'] {{(pid=92348) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 16 09:04:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 16 09:04:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 16 09:04:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6': None} {{(pid=92348) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 16 09:04:54 devstack cinder-volume[92348]: DEBUG cinder.volume.drivers.quobyte [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c04d77-0c8e-403c-a81b-05324f2b27c6'] {{(pid=92348) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 16 09:04:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.lockutils [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92348) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 16 09:04:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 16 09:04:54 devstack sudo[111808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619 Jun 16 09:04:54 devstack sudo[111808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 16 09:04:54 devstack sudo[111808]: pam_unix(sudo:session): session closed for user root Jun 16 09:04:54 devstack cinder-volume[92348]: DEBUG oslo_concurrency.processutils [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b0aa132ac259fc6c33db19da3586619" returned: 0 in 0.654s {{(pid=92348) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 16 09:04:54 devstack cinder-volume[92348]: DEBUG cinder.manager [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] Notifying Schedulers of capabilities ... {{(pid=92348) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 16 09:04:54 devstack cinder-volume[92348]: INFO cinder.volume.manager [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] Deleted volume successfully. Jun 16 09:04:54 devstack cinder-volume[92348]: DEBUG cinder.coordination [None req-8b0ab2b7-81f7-4de1-b5ec-679373a0015c tempest-CinderUnicodeTest-697625162 None] Lock "cinder-d0a44d8d-e03a-40e6-a612-e4b1662bcc38-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=92348) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 16 09:05:04 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:UPDATE=140,cinder:SELECT=105,cinder:INSERT=38,cinder:DELETE=7 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 16 09:05:04 devstack cinder-volume[92348]: DEBUG dbcounter [-] [92348] Writing DB stats cinder:SELECT=88,cinder:INSERT=35,cinder:UPDATE=123,cinder:DELETE=14 {{(pid=92348) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}